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The biological theory of adaptive dynamics proposes a descrip- 
tion of the long-term evolution of a structured asexual population. It 
is based on the assumptions of large population, rare mutations and 
small mutation steps, that lead to a deterministic ODE describing 
the evolution of the dominant type, called the "canonical equation of 
adaptive dynamics." Here, in order to include the effect of stochas- 
ticity (genetic drift), we consider self-regulated randomly fluctuating 
populations subject to mutation, so that the number of coexisting 
types may fluctuate. We apply a limit of rare mutations to these pop- 
ulations, while keeping the population size finite. This leads to a jump 
process, the so-called "trait substitution sequence," where evolution 
proceeds by successive invasions and fixations of mutant types. Then 
we apply a limit of small mutation steps (weak selection) to this jump 
process, that leads to a diffusion process that we call the "canonical 
diffusion of adaptive dynamics," in which genetic drift is combined 
with directional selection driven by the gradient of the fixation prob- 
ability, also interpreted as an invasion fitness. Finally, we study in 
detail the particular case of multitype logistic branching populations 
and seek explicit formulae for the invasion fitness of a mutant de- 
viating slightly from the resident type. In particular, second-order 
terms of the fixation probability are products of functions of the ini- 
tial mutant frequency, times functions of the initial total population 
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size, called the invasibility coefficients of the resident by increased 
fertility, defence, aggressiveness, isolation or survival. 

1. Introduction. Consider a multitype population where each individual 
of type X gives birth independently at rate b{x) to an individual of type x 
(clonal reproduction) and dies either naturally at rate d{x) or by competition. 
Deaths by competition are distributed as follows. Each individual of type 
y points to each individual of type x an independent exponential clock of 
parameter c{x,y). Death by competition of an individual of type x occurs 
as soon as a clock pointing to her rings. The vector of subpopulation sizes 
is distributed as the so-called multitype logistic branching process [23] . 

In this model the population size cannot go to infinity and eternal coex- 
istence of two or more types is impossible, so the number of types decreases 
until it reaches 1 at some random time T called the fixation time. For a two- 
type population starting with n individuals of type x and m individuals of 
type y, we denote by Un^m{x,y) the probability that y fixes, that is, that y is 
the surviving type at time T. We refer to neutrality as the case when x = y. 
After time T the population is said to be monomorphic. If the natural death 
rate d of the surviving type is not zero, the population eventually becomes 
extinct, otherwise the size process is positive-recurrent. 

The previous observations also apply to the population dynamics con- 
sidered in this paper, that generalize the logistic branching process to a 
multitype setting with mutation and more general interactions, and that 
we call GL-populations. Types live in a subset JV of and, in a pure x- 
type population of size n, any individual gives birth to a new individual at 
rate b{x,n) and dies at rate d{x,n). We assume that d{-, 1) = (i.e., extinc- 
tion is impossible) and that, uniformly in x, b{x, •) is bounded, and d{x, •) 
bounded from below by some positive power of the total population size. 
Then, when there is no mutation, the size of a pure j;-type population is 
positive-recurrent, as for the logistic branching process when natural death 
rates vanish, and converges in distribution to some random variable (,{x). 
However, in general, reproduction is not clonal. Specifically, each time an 
individual of type x gives birth, the type of the newborn individual is x with 
probability 1 — /i(x) and is x + h with probability ii{x)M{x, dh), where //(x) 
is the mutation probability and M(x, •) is a probability measure on X — x 
called the mutation kernel or mutation step law. In this setting, the loss of 
diversity is counteracted by the occurrence of mutations, and the number of 
types can also increase. 

The evolution of structured populations (with or without the presence 
of mutations) has long been studied, and in numerous different models. 
The renowned field that takes into account the complexity of the genetic 
structure — x is a genotype — is called population genetics [6, 11, 15, 21]. 
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The emerging field where the emphasis is put on the structure of ecological 
interactions — x is a phenotypic trait, such as body size — is called adaptive 
dynamics [17, 26, 28]. The link between both is still unclear, but see [22, 31]. 

Let T„ denote the reth time when the population becomes monomorphic 
and Vn the then surviving type. The (possibly finite) sequence (Vn) is of 
obvious interest to evolutionary biologists and is called the trait substitu- 
tion sequence. It can be defined in much more general contexts, as soon as 
eternal coexistence of two or more types is not permitted by the model. 
It was in adaptive dynamics that this sequence was invented and studied 
[3, 29], under two additional assumptions. First, the biologically motivated 
assumption of rare mutations guarantees that, in the timescale of mutations 
(speeding up time), the widths of time intervals during which the population 
is polymorphic vanish, so that there is one and only one type surviving at 
any time t. To prevent the population from rapidly becoming extinct in the 
new timescale, one also has to rescale population sizes, thereby making the 
assumption of large populations. 

Subsequently, the trait substitution sequence (TSS) is a Markov jump 
process on X whose semigroup is shown [3] to depend especially on the 
invasion fitnesses (as defined in [28]) f{x,y), x,y £ X, where f{x,y) is the 
expected growth rate of a single individual of type y — the mutant — entering a 
monomorphic population of type x "at equilibrium" — the residents. The evo- 
lution of the population can be described by this fitness function because of 
the large population assumption, which implies that deleterious mutants — 
those with negative invasion fitness — can never invade. Thus, evolution pro- 
ceeds by successive invasions of advantageous mutant types replacing the 
resident one (selective sweeps [27]), which can be summarized by the jump 
process of fixed types (the TSS), also called phenotypic traits, or simply 
traits, in the adaptive dynamics setting (e.g., size, age at maturity or rate 
of food intake). 

The TSS has been a powerful tool for understanding various evolutionary 
phenomena, such as evolutionary branching (evolution from a monomorphic 
population to a stably polymorphic one [29] that may lead to speciation [7] ) 
and is the basis for other biological models, such as the "canonical equation 
of adaptive dynamics" [4, 8]. This last phrase refers to the following ODE, 
describing the evolution of a one-dimensional trait x, obtained from the TSS 
in the limit of small mutations 



where a{x)'^ stands for the variance of the mutation step law, n{x) for the 
equilibrium size of a pure x-type population and f{x,y) for the aforemen- 
tioned invasion fitness. Note how only advantageous types get fixed (the 
trait follows the fitness gradient). 
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However, it is well known that slightly deleterious types can be fixed in fi- 
nite populations. This phenomenon is known under the name of genetic drift 
(more generally, this term refers to allelic fluctuations which have stochas- 
tic causes). Depending on the strength of genetic drift, selection is said to 
be strong (genetic drift has negligible effects) or weak. Adaptive dynamics 
models usually assume infinite populations subject to deterministic dynam- 
ics, where only strong selection can be observed. As a consequence, the 
first goal of this paper is to consider finite populations, thereby allowing for 
genetic drift and weak selection [20], and continue using the bottom-up ap- 
proach of adaptive dynamics; that is, model (macroscopic) evolution from 
(microscopic) populations [5]. In particular, we allow the population sizes to 
fluctuate randomly through time, in contrast to classical works in both pop- 
ulation genetics (where the population size traditionally remains constant; 
see [24]) and adaptive dynamics (where population sizes are infinite). 

Thus, we consider GX-populations in which the mutation probabilities 
are replaced with 7// and time t with t/'j (mutation timescale). We prove the 
existence as 7 vanishes (rare mutations) of the limiting TSS and characterize 
its law (Theorem 3.2). Recall that Un.m{x,y) denotes the fixation probability 
of type y in a two-type population starting with n individuals of type x and 
m individuals of type y and let T„ denote the nth mutation time. 

Theorem 1.1. The process {S^;t>0) defined as 

= X] ^ni{T„<t/^<Tn+i} 
n>0 

converges in law for the Skorohod topology on D(M+, ^) as j ^ to a pure- 
jump Markov process {St;t > 0), whose jumping rates q{x,dh) from x to 
X + h are given by 

q{x, dh) = I3{x)x{x, x + h)M{x, dh), 

where 

p{x)=fi{x)E{^{x)b{x,^{x))) 

and 

^ nb{x,n)F{^{x) = n) 

'g. EKWKx.ax))) 

Observe that /3{x) is the mean mutant production rate of a stationary 
x-type population and that xi^^y) is the probability of fixation of a single 
(mutant) y-type mutant entering a pure (resident) x-type population with 
b{x,-)- size-biased stationary size. In particular, xi^^y) the random ana- 
logue of the usual invasion fitness. More precisely, with the notation of (1), 
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I3{x) is analogous to ^{x)h{x)nx and xi^iU) is the exact counterpart of the 
expression [/(x,y)]+/6(y) obtained in [3] for the probabihty of fixation of a 
y-type mutant in an equihbrium x-type population. 

The second goal of this paper is to take the limit of small mutations on 
the TSS defined in the last theorem. Namely, assume for simplicity that 
A' = M*^, and denote by Z*^ the process S modified by replacing M(x, •) with 
its image by the contraction e Id and time t with t/e^ . Under some technical 
assumptions which ensure that xi^^') is differentiable, and assuming that 
mutation steps have zero expectation [/ hM{x, dh) = 0], we get the following 
theorem (Theorem 4.2), where (j{x) is the symmetric square root matrix of 
the covariance matrix of M(x, •) and V2 denotes the gradient taken w.r.t. 
the second variable. 

Theorem 1.2. The process Z'' converges in law for the Skorohod topol- 
ogy on D(M+,IR'^) to the diffusion process {Zt;t > 0) unique solution to the 
stochastic differential equation 



(3) dZt = (3{Zt)a\Zt) ■ V2XiZt, Zt) dt + ^ (i{Zt)x{Zu Zt)a{Zt) ■ dBt, 



where B is a standard k- dimensional Brownian motion. 

In words, we obtain a diffusion model for the evolution of a trait grounded 
on microscopic realistic population dynamics. The diffusion term embodies 
genetic drift. It is proportional to the mean mutant production rate /3(x), 
to the neutral fixation probability xi^^x) ^iid to the covariance matrix of 
M(x, ■). The deterministic term embodies directional selection, and is the 
exact counterpart of the ODE (1). 

This equation, that we christen "canonical diffusion of adaptive dynam- 
ics," involves the stochastic invasion fitness x ^-^id its gradient with respect 
to the second variable at neutrality. As seen in the definition (2) of Xi the 
fitness gradient only depends on the behavior of the fixation probabilities 
near neutrality for two interacting types (see also [24]) and on the stationary 
distribution ^{x). The explicit computation of these quantities is possible in 
the multitype logistic branching case, which we study in detail. 

First consider a pure x-type logistic branching population with dynamical 
parameters (6(x), c(x, x), d(x)). When d = 0, the population size is positive- 
recurrent and the r.v. ^ distributed according to the stationary probability 
is a Poisson variable of parameter 9 := b/c conditioned on being nonzero. 
This yields 



/?(x) = //(x)6(x)E(C(x)) 



/u(x)6(x) 



e{x) 



1 - e-^(^) 



and 



X{x,x) 



i + e{x) 



e{xf 
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Second, we characterize the two-type logistic branching process by a birth 
vector B, a competition matrix C and a death vector D: 

where 1 is a matrix of ones with dimensions ad hoc and X,5,a,£,a are the se- 
lection coefficients of the mutant respectively associated to fertility, defence, 
aggressiveness, isolation and survival. In the following theorem (Theorem 
5.1), we prove that each partial derivative of the fixation probability w.r.t. 
any selection coefficient factorizes as a function of the initial mutant fre- 
quency p [either p{l — p) or p(l — p)(l — 2p)] times a function of the initial 
total population size, called the invasibility coefficient of the resident popu- 
lation. 

Theorem 1.3. As a function of the multidimensional selection coeffi- 
cient s = {X,6,a,e,ay , the probability u is differentiable, and in a neighbor- 
hood o/ s = (selective neutrality), 

u = p + v'-s + o(s), 

where the (weak) selection gradient v = {y^ ,v^ ,v'^ ,v^ ^v")' can be expressed 
as 

Vn,m=P{'^-p)9n+m, ^ / 

and the invasibility coefficients g depend solely on the residents character- 
istics b, c, d and on the total initial population size n + m. 

As a result, we get 

V2x(x,x) = e~^^'-^\ax{x)Vb{x) - as{x)V ic{x , x) + aa{x)V 2c{x , x)) , 

where a\, as and Oa are called adaptive slopes in terms of respectively fer- 
tility, defence and aggressiveness. Explicit formulae are provided for the 
adaptive slopes as well, that can be plugged into (3). These results allow to 
get deeper insight into the canonical diffusion of adaptive dynamics when 
the microscopic interactions are those of multitype logistic branching pro- 
cesses. 
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The paper is organized as follows. First, our stochastic individual-based 
model is described in the next section (Section 2). Next, we state precisely 
the convergence results to the TSS in finite populations (Section 3) and 
to the canonical diffusion of adaptive dynamics (Section 4). In Section 5 
we stick to the logistic branching case and obtain explicit formulae for the 
derivative of the fixation probability, the invasibility coefficients and the 
adaptive slopes. Finally (Section 6), we give the detailed proofs of the con- 
vergence results of Sections 3 and 4. 



2. Model. 



2.1. Preliminaries. Recall from the Introduction that a monotype (bi- 
nary) logistic branching process with dynamical parameters (6, c, d) is a 
Markov chain in continuous time {Xt ;t>0) with nonnegative integer values 
and transition rates 

bi, ifj=i + l, 

ci{i — 1) + di, if J = i — 1, 

—i{b + c{i — l)+d), iij = i, 
0, otherwise. 

We know from [23] that oo is an entrance boundary for X and that Eqo (t) < 
oo, for r the hitting time of, say, 1. If d^ 0, then the process goes extinct 
a.s., and ii d = 0, it is positive-recurrent and converges in distribution to a 
r.v. ^, where ^ is a Poisson variable of parameter 9 := b/c conditioned on 
being nonzero: 

(4) ^(^ = ^) = T^7r' ^^1- 

Notice that E(0 = 9/(1 - exp{-9)). 

For fixed a > 0, one can generalize the interaction in the previous model to 
obtain the so-called a-logistic branching process with dynamical parameters 
(6, c, d) by modifying the transition rates as 

bi, if j = i + 1, 

ci{i — 1)" + di, if j = i — 1, 

-i{b + c{i-l)"' + d), ifj = i, 

0, otherwise. 

As before, it is easy to check that, when dy^O, the process goes extinct a.s., 
and when d = 0, it is positive-recurrent and converges in distribution to a 
r.v. which law can be explicitly computed as 

(5) 'K'°' = ') = ^I((i^- 

where 9 = b/c and C scales the sum of these terms to 1. 



a 
lij 
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2.2. GL-populations. In this subsection we define the general popula- 
tions considered in this paper, that we call GL-populations, and give their 
basic properties. These populations are structured (multitype) populations 
with mutation. Their dynamics are those of eternal birth-and-death pro- 
cesses with birth rates at most linear and death rates of order at least 1 + a 
in the total population size, hence, their name (generalized logistic). 

2.2.1. Definition. At any time t, the population is composed of a finite 
number N{t) of individuals characterized by their phenotypic traits, or sim- 
ply traits, xi{t), . . . ,X7v(t)(i) belonging to a given trait space X, assumed to 
be a closed subset of M^' for some A; > 1 . The population state at time t will 
be represented by the counting measure on X: 

N(t) 
i=l 

Let us denote by A4 the set of finite counting measures on X, endowed 
with the (T-field induced by the Borel c-field on A" C M'^ as follows: let 93 
denote the application mapping any element J2i=i ^x, of Ai to the fc-tuple 
(x7r(i) , . . . , a;7r(fc)) where the permutation vr of {1, . . . , fc} is chosen such that 
this vector is ranked in, say, the lexicographical order. Then, this function 
ip is a bijection from A4 to the set of lexicographically ordered vectors of 
ULo^''- The Lebes gue (T-field on this set therefore provides a o"-field on . 

For any v € A4 and any measurable function / : A' — > M, we will use the 
notation {1^, f) for / f{x)v[dx). Observe that N{t) = {ut, 1) and that {i^t, Ir) 
is the number of individuals at time t with trait value in F C 

Let us consider a general structured birth-and-death process with muta- 
tion whose present state is given by the point measure v: 

• b{x, v) is the rate of birth from an individual of type x in a population in 
state V. 

• d{x, v) is the rate of death of an individual of type x in a population in 
state V. 

• ^iJi{x) is the probability that a birth from an individual with trait x pro- 
duces a mutant individual, where n{x) G [0, 1] and where 7 G (0, 1) is a 
parameter scaling the frequency of mutations. In Section 3 we will be 
interested in the limit of rare mutations (7 — > 0). 

• M{x,dh) is the law of the trait difference h = y — x between a mutant 
individual with trait y born from an individual with trait x. Since the 
mutant trait y = x + h must belong to X, this measure has its support 
in X — X := {y — x:y ^ X} C M^. We assume that M{x, dh) has a density 
on M*^ which is uniformly bounded in x G by some integrable function 
M{h). 



ADAPTIVE DYNAMICS FOR FINITE POPULATIONS 



9 



In other words, the infinitesimal generator of the A^-valued Markov jump 
process (f7)t>o is given by 



L^ip{u)= / [ip{i^ + 6^) - ip{u)]{l - jfi{x))b{x,u)iy{dx) 
(6) + / / ^ ^x+h) - Hi{v)\lii{x)h{x,v)M{x,dh)v{dx) 

+ / [p{u - 6x) - ip{v)]d{x,u)v{dx). 

JX 

We will denote by P''' the law of this process (or ¥1^^ when the initial condition 
has to be specified). When necessary, we will denote the dependence of ut 
on the parameter 7 with the notation v'J . 

Definition 2.1. We say that the structured birth-and-death process 
with mutation defined previously is a GZ-population, if: 

• there is b such that, for any v and x, < h{x, v) < b, 

• there are c and a > such that, for any v and x, c {{v, 1) — 1)" < d{x, u), 

• ly = 5x, then d{x, z^) = 0. 

The classical structured logistic branching process [5, 9, 13, 23] is a GL- 
population with 

b{x, u) = b{x) 

and 

d{x,u)= / c{x,y){u -6x){dy). 

JX 

Then, the assumption above translates as b{-) <b, a = 1 and c(-, •) > c. 



2.2.2. Basic properties. First, the total population size Nf = {vt, 1) of a 
GZ-population is dominated by a scalar a-logistic branching process with 
parameters (5,c, 0), so > 0) has infinite lifetime. 

Second, when there is only one individual in the population (vt = for 
some X £ X), the death rate equals 0, so that extinction is impossible. 

Third, for a GX-population with two types x and y and no mutation 
(// = 0), = Xt6x + Yt6y, where {Xt,Yt :t>0) is a bivariate Markov chain. 
We refer to (selective) neutrality as the case when x = y. Because of the 
previous domination, for the Markov chain (X,Y), the union of the axes 

Oi:=Nx{0} and := {0} x N 

is accessible and absorbing, and its complementary set is transient. So P(T < 
00) = 1, where T := Tn^ A Tq^, and for any subset F of N^, Tr denotes the 
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first hitting time of T by {X,Y). Also notice that for any (n,m) ^ (0,0), 
^n,miTni = Tq^) = 0. Then we call fixation (of the mutant y) the event 
{Tfi^ < Tfi^}. The probability of fixation will be denoted by Un.m{x,y)- 

Un,m{x,y) :=F{Tn.^ <Tn^\Xo = n,Yo = m). 

More generally, we have the following result. 

Proposition 2.2. Consider a GL-population (ft;t >0) with no muta- 
tion. For any initial condition, the fixation time T , 



is finite a.s. and from time T , the population remains monomorphic with 
type, say, x. Then conditional on T and x, the post-T size process {N{t);t > 
T) is positive-recurrent and converges in distribution to a random integer 
^(x) such that sup^. E(^(x)'^) < oo for any n. 

Proof. This result follows from the domination of the total population 
size by a a-logistic branching process {Zt;t > 0) with dynamical parameters 
(5,c, 0), and from the fact that such a process is positive recurrent with 
stationary distribution given by (5). Then, the total population size hits 
1 in a.s. finite time (greater than or equal to T), and the population size 
returns then to 1 in a time bounded by the time of return to 1 of Z, which has 
finite expectation as a consequence of its positive-recurrence. So the post-T 
size process N is positive-recurrent as well and its stationary distribution is 
dominated by the law (5), which has finite moments. □ 

More generally, the domination of the population size (f^j 1) by a mono- 
type a-logistic branching process with dynamical parameters (b, c, 0) for any 
7 G (0,1) allows us to prove the following long time bound for the moments 



Proposition 2.3. Fix p > 1 and pick a positive C . There is a constant 
C such that, for any 7 G (0, 1), 



Proof. With the notation of the previous proof, it suffices to show 
that supi>o IE(.^f ) < +00. Let us define p^ = ¥{Zt = k). The backward Kol- 
mogorov equation reads 



r:=inf{t >0:|Supp(i/)| = 1}, 



of v^. 





d 

IE 



,E(Zf ) = ^ F 



k>l 



dt 
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kP[b{k - i)pt' + c{k + i)kyl+' -k{h+c{k- ir)p1] 

k>l 



E 

fc>i 



Mii+iy-i)+.(^-ir((i-iy-i 



Pf 



Now, for any k > fco, where ko := + 1, c{k — 1)" > 2b. Therefore, 

for k> ko, 

+ i/k)p - 1) + c{k - - i/ky - 1) 

<_b[s_2il-l/kf-{l + l/k)P], 
which is equivalent to —bp/k. Then, enlarging kQ if necessary, we obtain 

k=l fc>fco+l 
<ir-|E(Zf), 



where the constant K depends solely on kQ. This differential inequality yields 

E(^f ) < ^ + («) - 
which gives the required uniform bound. □ 

3. The trait substitution sequence in finite populations. In this section 
we consider the Giy-population i'"' of Section 2. Our goal is to apply to this 
process a limit of rare mutations (7^0), while keeping the population size 
finite, in order to describe the evolutionary process on the mutation timescale 
t/7 as a "trait substitution sequence" (TSS, [3, 29]) where evolution proceeds 
by successive fixations of mutant types. 

Let us introduce the following strong form of convergence in law. We will 
say that a sequence of random variables converges strongly in law to 

a r.v. Y if and only if E(/(X„,)) E(/(y)) as n — > 00 for any bounded 
measurable real function /. Let us also make a slight abuse of notation 
by writing b{x,n) instead of b{x,n5x) for the birth rate in a monomorphic 
population (as in the Introduction). 

Fix X (z X. For 7 € (0, 1), let the population start at i/q = Nq5x, where the 
N*-valued random variables Nq satisfy sup^g^Q E((A'^q )P) < 00 for some 
p>l. 

Theorem 3.1. For any < ti < • • • < t„, the n-tuple {i^^^/^, ^J^i^ 
converges strongly in law to {Cu ) • • • > Ctn ) > where Cu = ^St j ^.''^d 
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(i) {St;t > 0) is a Markov jump process on X with initial value Sq = x 
and whose jumping rates q{x, dh) from x to x + h are given by 

(7) q{x, dh) = P{x)x{x, x + h)M{x, dh), 

where 



(8) /?(x)=//(x)E(C(x)6(x,e(x))) 
and 

^ nb{x,n)F{^{x) = n) 

(ii) Conditional on {St^ , . . . , St„) = (xi, . . . , Xn), the Nt^ are independent 
and respectively distributed as ^(xj). 



Observe that (3{x) in (8) can be seen as the mean mutant production 
rate of a stationary x-type population, and that x(^5 v) is the probability 
of fixation of a single y-type mutant entering a pure x-type population 
with b{x,-)- size-biased stationary size. In particular, xi^^y) is the random 
analogue of the traditional invasion fitness, in the sense proposed by Metz, 
Nisbet and Geritz [28]. 

This result shows that, in the limit of rare mutations, on the mutation 
timescale, the population is always monomorphic and that the dominant 
trait of the population evolves as a jump process over the trait space, where 
a jump corresponds to the appearance and fixation of a mutant type. 

Let us denote by the nth mutation time (tq = 0) , by p„ the first time 
after time t„ when the population becomes monomorphic, and by Vn the 
single trait value surviving at time pn {po = if the initial population is 
monomorphic). With this notation, we can state the following result, ad- 
dressing the main biological issue of Theorem 3.1, namely, the convergence 
of the support of the measure i^^^ to the process S. 

Theorem 3.2. The process {S^;t > 0) defined as 

oo 

=^ ^nl{pn<t/7<Pn+l} 

n=0 

converges in law for the Skorohod topology on I}{M^,X) as 7 — > to the 
process {St;t > 0) with initial state Sq = x characterized by (7). 

Observe that such a convergence for the measure v'J^^ cannot hold because 
the population size Nt in Theorem 3.1 is not a cadlag process. 
The proofs of the two preceding theorems are put to Section 6.2. 
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4. The canonical diffusion of adaptive dynamics. 

4.1. Notation and assumptions. For any integer r, we denote by the 
set of r times differentiable functions with (image space ad hoc and) all 
derivatives bounded. 

For a two-type GL-population, we will make a slight abuse of notation by 
writing b{x , y , n{x) , n{y)) instead of b{x,n{x)6x + n{y)5y) and the analogue 
notation for the death rate. 

If |[ • II is the norm, for any i = (n, m) and j such that \\j — i\\ =1, then 
let TTij stand for the transition probability of the embedded Markov chain 
associated to the two-type GX-population without mutation. For example, 
ifi-i = (l,0), 

TTij {x,y) = nb{x, y,n,m) x {nb{x, y,n,m) + mb{y, x,m,n) 

(10) ^ 

+ nd{x,y,n,m) + md{y,x,m,n)) 

From now on, we make the following additional assumptions: 

• ^ = M*"' for simplicity, 

• for all n,m, the functions b{-,-,n,ni) and d{-,-,n,m) are in C^, 

• there are constants Ci,C2 such that, for any x,y X, for any i = {n,m) 
and j such that \\j — i\\ = 1, 

(11) ||V2vr,j(x,y)|| <Ci, \\H27^^j{x,y)\\<C2, 

where V2 is the gradient and H2 the Hessian matrix taken w.r.t. the 
second variable, 

• the mutation kernels M{x, •) satisfy: 

- for any x G M'^, M(x, •) has expectation, that is, J^k hM{x,dh) = 0. 

- the covariance matrix of M(x, •) has Lipschitz entries and is uniformly 
elliptic in x, that is, there is a positive constant C such that 
J^kis'h)^M{x,dh) > CWsW^ for any sSM*^. 

- the third-order moments of M{x, •) are uniformly bounded in x. 

Recall that there is a symmetric matrix (t(x) such that (t(x)(t(x)' = (t(x)^ 
is the covariance matrix of M{x,-) which is called its square root. Then its 
uniform ellipticity ensures that o'{x) has also Lipschitz entries in x. 

4.2. Differentiability of the probability of fixation. In the following theo- 
rem we state the existence of the partial derivatives of Un,m{x,y), and show 
that these derivatives are always sublinear in the initial condition. We also 
give a uniform bound for the second-order derivatives of the fixation prob- 
ability. 
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Theorem 4.1. (a) The fixation probability y ^ Un,m{x,y) is differen- 
tiable and its derivative Vn,mix,y) satisfies 

(12) sup " < +00. 

n,m,x,y Tl -\- TTl 

(h) In addition, y ^ Un,m{x,y) is in C^, and its second-order derivatives 
are bounded by c{n + m)^, where c does not depend on x and y. 

This theorem wih be proved in Section 6.3. 

It is easy to see from the last theorem and from the fact that ^{x) is 
stochastically dominated by a random variable with law (5) (with b = b and 
c = c) that the function x defined in (9) is in C^. 

4.3. The canonical diffusion of adaptive dynamics. Here, we want to ap- 
ply a limit of small mutation steps (weak selection) to the TSS S defined 
in the previous section, in order to obtain the equivalent of the canonical 
equation of adaptive dynamics, but in finite populations [4, 8]. 

The limit of small jumps is obtained by introducing a parameter e > and 
replacing the mutation kernels M(j;, •) with their image by the application 
h I— > eh. Of course, this scaling of jumps' sizes has to be combined with 
a scaling of time in order to observe a nontrivial limit. This leads to the 
following generator for the rescaled TSS {Zl;t > 0) (as will appear further 
below, the factor 1/e^ is the right timescaling) : 

(13) A^ip{x) = \ [ (ip(x + €h)-ip(x))/3(x)xix,x + eh)M(x,dh). 

Fix a function ip in C^. For any x,h and e > 0, there exists < ei < e 
such that 

ip{x + eh) — ip{x) = eh Vip{x) + —h'Hip{x + eih)h, 

where Hip{y) denotes the Hessian matrix of f at y, and there exists < €2 < e 
such that 

x{x,x + eh) = x{x,x) + eh'V2x{x,x + £2/1), 

where V2X is the gradient of x w.r.t. the second variable. Therefore, using 
the fact that Hip and V2X bounded Lipschitz functions, it takes only 
elementary computations to prove that 

{ip{x + eh) - ip{x))x{x, X + eh) 

= e{h'Vipix))x{x, x) + e\h'Vipix)){h'V2x{x, x)) 

+ '^{h'H^{x)h)x(x,x) +0{e^hf), 
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where the 0(e^||/i|p) is uniform in 2; S R'^. Now, since the mutation kernel 
has zero expectation, 

{h'S/ip{x))xix,x)M{x,dh) =0. 

Combining these results, thanks to boundedness of the third-order moments 
of the mutation kernel, we easily obtain, for any £C^, that A^^ip converges 
uniformly to the function Aqlp defined as 



Aoip{x)= / {h'Vip{x))/3{x){h'V2x{x,x))M{x,dh) 

(14) 

+ i / {h'Hip{x)h)(3{x)x{x,x)M{x,dh). 



In view of this, the following theorem is natural. Recall that (t{x) is the 
symmetric square root matrix of the covariance matrix of M(x, •), which is 
Lipschitz in x. 

Theorem 4.2. If the family (ZQ)e>o has bounded first-order moments 
and converges in law as e ^ to a random variable Zq, then the process 
generated by (13) with initial state Zq converges in law for the Skorohod 
topology on B(R-|_,M'^) to the diffusion process {Zt;t > 0) with initial state 
Zq unique solution to the stochastic differential equation 



(15) dZt = p{Zt)a\Zt) • V2X{Zt, Zt) dt + ^ (3{Zt)x{Zu Zt)a{Zt) ■ dBt, 
where B is a standard k- dimensional Brownian motion. 

Theorem 4.2 will be proved in Section 6.4. 

Note that, by an elementary martingale (or exchangeability) argument, 
the neutral fixation probability Un^m{x,x) equals m/{n + m), so that 

•sr-^ nb(x,n)F(^(x) = n) 1 

X{x,x) = 



E(e(x)6(x,e(x))) n + 1 
1 _^fax)b{x,ax)) 



E{ax)b{x,ax))) \ l + ^x) 



Remark 4.3. In the case where X ^M.^, this result is still valid, apart 
from the following technical difficulties. First, for the process to be well 
defined, one needs to assume that scaling the mutation law M{x, dh) cannot 
drive Z^ out of X. This is true, for example, when e < 1, if is convex, or 
if Supp {M (x , dh)) is convex for any x (z X. Second, uniqueness in law has 
to hold for the diffusion with generator Aq. For example, one can ensure 
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the existence of a Lipschitz factorization a{x)a{xy of the covariance matrix 
of M(x, •) by assuming that the function from X to the set of nonnegative 
symmetric matrices mapping x to the covariance matrix of M(x,-) can be 
extended to M.^ in a fashion (see [14]). 

Remark 4.4. In the case where the mutation step law M(x,-) has 
nonzero expectation, the calculation above shows that the first-order term in 

does not vanish, so that the correct timescaling is 1/e (instead of 
and the TSS process can be shown to converge to the solution of the 
deterministic ODE 



In this case, the main force driving evolution is the mutation bias. The 
mutation rate /3(x) and the fixation probability x{x,x) only affect the speed 
of evolution. 

Theorem 4.2 gives the equivalent of the canonical equation of adaptive 
dynamics [4, 8] when the population is finite. It is no longer a deterministic 
ODE, but a diffusion process, in which the genetic drift remains present, as 
a consequence of the population finiteness and of the asymptotic of weak 
selection (e ^ 0). 

Diffusion processes have long been used as tools for evolutionary biology, 
but mainly to describe the fluctuations of allelic frequencies (see, among 
many others, [11, 12, 19]). In sparser works [16, 25], a diffusion can describe 
the evolution of the dominant or mean value of a quantitative trait in a 
population. Our process provides such a model, but it is grounded on a 
microscopic precise modeling of the population dynamics, in a realistic way. 
In particular, the population size is not fixed and may fluctuate randomly 
through time but remains finite because of the density-dependence. 

The diffusion part in (15) gives the strength of genetic drift: its square 
is proportional to the mutation rate /3(x), the neutral fixation probability 
x{x,x) and the covariance matrix of the mutation step law M{x,dh). As 
for the deterministic drift part, observe the similarity with the standard 
canonical equation of adaptive dynamics (1). This term gives the expression 
of the deterministic strength driving evolution, which is often related in 
macroscopic evolutionary models to a fitness gradient. In our case, the fitness 
is given by the function Xi which appears in the deterministic part of (15) 
in the shape of its gradient with respect to the second variable, in a similar 
way as in (1). Therefore, the "hill-climbing" process of evolution occurs 
here, as in the classical models of adaptive dynamics, in a fitness landscape 
y ^ xi^jU) that depends on the current state x of the population. 
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5. The logistic branching case. In this section we restrict our attention 
to the structured logistic branching process described in the Introduction 
and in Section 2. Since we seek exphcit expressions for the drift and diffu- 
sion parts of the canonical diffusion, we are only concerned with two-type 
populations with no mutation. 

5.1. Preliminaries. Since mutations are absent, we will usually call the 
first type (1) resident (or wild type) and the second type (2) mutant. Then 
for i,j G {1,2}, bi (resp. di) is the birth (resp. death) rate of type i, and Cij 
is the competition rate felt by an individual of type i from an individual of 
type j- 

Formally, the two-type logistic branching process is a bivariate integer- 
valued continuous-time Markov process (Xt,Yt;t > 0) with rate matrix Q = 
{qij;i G N2,i G N^), where 

'bin, if z = (n, m) and j = (n -|- 1, m), 

b2m, if z = (n, m) and j = (n, m + 1), 

ciin(n — 1) + Ci2nm + din, if z = (n, m) and Z = (n — 1, m), 

C2imn + C22?7z(m — 1) -|- d2m, if z = (n, m) and j = (n, m — 1), 
-Tnm, if i = {n,m) and j = {n,m), 

0, 

and where the total jumping rate r„ 
from {n,m). 

The law of this process conditioned on fixed initial state {n,m) will be 
denoted by Pn,m- Let B denote the birth vector, C the competition matrix 
and D the death vector: 

'bl\ ^^fcil Cl2\ j^^fdl 

02) \C21 C22) V"2. 

To comply with the GL-population framework, we will always consider that 
C11C12C21C22 7^ 0. Assuming that the presence of a mutant form does not 
modify the dynamical characteristics (6, c, d) of the resident, we may focus on 
deviations from the neutral case so as to express the dynamical parameters 
as 

0^ 



otherwise, 
is the sum of the four jumping rates 



B 



B = bl + 



C = cl 



D = dl 



0\ /O a 
6 5y\0 a 



e 
e 



In words, deviations from the neutral case are a linear combination of five 
fundamental (additive) selection coefficients A, 5, a, e, a that are chosen to 
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be positive when they confer an advantage to the mutant. In the sequel we 
win see that it is indeed convenient to assess deviations to the neutral case 
with the help of selection coefficients in terms of: 

1. fertility (A, as the usual letter standing for growth rate in discrete-time 
deterministic models): positive A means increased mutant birth rate, 

2. defence capacity {6, as in defence): positive 6 means reduced competition 
sensitivity of mutant individuals w.r.t. the total population size, 

3. aggressiveness (a, as in aggressive, or attack): positive a means raised 
competition pressure exerted from any mutant individual onto the rest 
of the population, 

4. isolation (e, as in exclusion): positive e means lighter cross-competition 
between different morphs, that would lead, if harsher, to the exclusion of 
the less abundant one, 

5. survival {a, as in survival): positive a means reduced mutant death rate. 

Under neutrality, an elementary martingale argument shows that the fixa- 
tion probability equals the initial mutant frequency p := m/{m + n), that 
is, 

u = p. 

The goal of the following theorem is to unveil the dependence of u upon A, 
5, Q, e, a when they slightly deviate from 0. It is proved in Sections 5.3 and 
5.4. 

Theorem 5.1. As a function of the multidimensional selection coeffi- 
cient s = (A, (5, a, e, cj)', the probability u is differentiable, and in a neighbor- 
hood ofs = (selective neutrality), 

(16) u = p + v' ■ s + o{s), 

where the (weak) selection gradient v = (v^,v^,v°',v^,v'^)' can be expressed 
as 

Vn,m=Pi'^-p)9n+m, 7^ 
<,m=P(l -P)(l -2p)ff^,+^, 

where the g^s depend solely on the residents characteristics b,c,d and on 
the total initial population size n + m. They are called the invasibility coef- 
ficients. 

The invasibility coefficients of a pure resident population are interesting to 
study, as they provide insight as to how the fixation probability deviates from 
p as the selection coefficients of the mutant deviate from 0. Their name is due 
to the fact that they only depend on the resident's characteristics and are 
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multipliers of the mutant's selection coefficients [24]. In the next subsection 
we apply this result to the canonical diffusion of adaptive dynamics. The 
remainder of the section is then devoted to the proof of the theorem and the 
study of the invasibility coefficients. 

5.2. The canonical diffusion for logistic branching populations. Consider 
a logistic branching population satisfying the conditions given in Section 2.2.1. 
Recall that b{x) is the birth rate of x-type individuals, their death rate 
d{x) =0 and c{x,y) is the competition rate felt by x-type individuals from 
y-type individuals. Assume as in Section 4.1 that and c(-,-) are in C^. 
Since c(-,-) > c, it is then elementary to check that (11) holds. By (4), the 
invasion fitness is given by 

n>l n>l ^ ' 

where 6{x) = b{x) / c{x, x) . 
Observe that 
d 



dy 



y=x 



c(x,x) c(x,y)\ „ , ,/0 0\ ,^ , 1\ 



where, for bivariate /, Vj/ is the gradient of / w.r.t. the ith variable {i 
1,2). 

Recall Theorem 4.2 and the canonical diffusion of adaptive dynamics 



(17) dZt = l3{Zt)a\Zt) ■ V2XiZt, Zt) dt + p{Zt)x{Zu Zt)cj{Zt) ■ dBt, 

where is a standard fc-dimensional Brownian motion. From Theorem 5.1 
and elementary computations, we get (3{x) = fi{x)b{x)9{x) / {1 — e~^^^^) and 

f . -9M^ Oj^r-' e-^W-l + g(x) 

^,{n + l){n-l)\ e{xf 

and 

V2X{x,x) = e~^^^\ax{x)Vb{x) - as{x)'Vic{x,x) + aa{x)V 2c{x , x)) , 
where, for l = X,5, a, 

(18) a.(x) = E<r(x)(^ = E + 

n=l ^ ' n=l ^ ' ^ ' 

and g^, g^ , g°^ are the invasibility coefficients in terms of respectively fertility, 
defence, aggressiveness. Since the coefficients appear as factors of the 
gradients of the microscopic parameters b and c in the deterministic part 
of the canonical diffusion (17), we call them the adaptive slopes. Explicit 
formulae for invasibility coefficients and adaptive slopes are given in Section 
5.4. 
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Remark 5.2. Observe that e-invasibilities do not appear in this com- 
putation, because of the symmetry between resident and mutant types in 
the competition kernel. One could include e-invasibilities in the formula of 
'V2X{x,x) by assuming a competition matrix of the form 



for some functions ci and C2 coinciding on the diagonal. Such an asymmetry 
between resident and mutant would not be unrealistic biologically and could 
be explained by the resident constructing its own niche. This ecological 
adaptation of the resident to its medium would then result in a difference 
in the competition felt by x from y according to whether x is the resident 
or not. 

Example. Let us consider a one-dimensional trait x S M in a population 
undergoing symmetric competition c(rE, y) = c{\x — y\). This type of competi- 
tion kernel has been considered in numerous earlier works; see, for example, 
[7]. As a consequence, dc/dx{x,x) = dc/dy{x,x) = 0. We may and will as- 
sume that c(0) = 1. We still denote by cr{x) the standard deviation of the 
mutation step law M{x,-). Then, thanks to forthcoming Proposition 5.14 
about adaptive slopes (18), the canonical diffusion of adaptive dynamics is 
given by 



In forthcoming work this diffusion and other examples will be investigated. 

5.3. Fixation probability. Here, we go back to the two-type population 
with no mutation and characterize the fixation probability thanks to a dis- 
crete harmonic equation (corresponding to Kolmogorov forward equations). 
Then we prove Theorem 5.1. 

Proposition 5.3. The fixation probability Un,m is the unique bounded 
solution to 





where 




{Au)n,m = 



for (n, m) ^ r^i U 
for (n, m) € r^i, 
for (n,?n) G $^2, 



(19) 



= 



= 1 
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where A is the harmonic (its coefficients sum to zero) operator defined for 
any doubly indexed sequence w as 

{^w)n,m = rn,mWn,m " hnWn+l,m " b2mWn,m+l 

(20) - n{cu{n - 1) + ci2m + di)wn-i,m 

- m{c2in + C22(m - 1) + d2)Wn,m~l- 

Note that in the previously displayed equation, whenever a term is not 
defined, the multiplying coefficient is zero. The fact that Un,m satisfies (19) 
follows from the Markov property at the first jump time of {X,Y), and the 
uniqueness relies on Lemma 5.4 below. 

Lemma 5.4. Consider a subset T o/ such that Tr < +oo P„^m-fl-s- 
for any re, m > 0. Then, for any function / : L — s- M such that |/(re, ?re)|/(n + 
m + 1) is bounded on T, the equation 

{Ah)n,m = /or(re,m)^r, 

(21) 

h{n,m) = f{n,m) for {n,m) 
admits at most one solution h such that \h{n,m)\/{n + m + 1) is bounded. 

Proof. It suffices to prove that (21) with / = admit /i = as unique 
sublinear solution. Let h be such a function and fix re, m > 0. Then {h{Xt^TY > 
^tATr);^ > 0) is a P„^m-semi-martingale for t < Tr- Since, by Proposition 2.3, 
supt>oIEn,m((-'^t +^t)^) < +00, {h{Xt ,Yt))t>o is actually a uniformly inte- 
grable martingale. Applying the stopping theorem at time Tr, we get 

= E„,m(/l(-'^Tr,^Tr)lTr<+oo) = E„,m(/i(Xo, Iq)) =h{n,m), 
which completes the proof. □ 



Proof of Theorem 5.1. As seen in Proposition 5.3, the Kolmogorov 
forward equations translate into a discrete harmonic equation satisfied by 
u with boundary condition 1 on and on 0,2, written as {Au)n,m = 0, 
where A is defined in (20). Combining (16) and (20), and identifying second- 
order terms, we get 

rem 



(22) 



(Ao^;^) 



(re + Tre)(re + m + 1) 
nm 



n + m 



nm 



(re + m)(re + m — 1) 
nm{n — m) 

(re + m)(re + m — 1) 



if 
if 
if 

if i: 



A, 
5, 



■■ a, a, 
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where Aq corresponds to the neutral case of A: for any doubly indexed w, 

{/S.ow)n,m = {n + m) [b + c{n + m-l) + d]Wn,m - bnWn+l,m - bmWn,m+l 
(23) - n[c{n + m - 1) + d]wn-i,m - m[c{n + m - 1) + d]wn,m-i, 

n,m>0. 

We know from Theorem 4.1 that the vector v = {v , sub- 
linear in {n,m), that is, ( || Vn,m || /(^i- + "i))n,m is bounded. Since the r.h.s. 
in (22) are all sublinear, Lemma 5.4 ensures that v is the unique suhlinear 
vector in (n,m) solving (22). 

Thanks to this uniqueness result, it is sufficient to show that there are 
solutions of (22) of the following form: 

nm 



(24) 



if t = A, 5, a, a, 

+ 1 b~V- lib' J J 7 7 

m 

nm{n — m) ^ 



n + m 

where, for e, u'' is a bounded real sequence indexed by N — {0, 1} (n^ has 
no effect on the values of Vi q and Vqi), and is a real sequence indexed by 
N — {0, 1, 2} (nf and have no effect on the corresponding values of ^) 
such that {nu^)n is bounded. The proof will then end up by writing 

u!^, if i = A, (5, a, cr, n > 2, 
n^n^, if i = e, n > 3. 



(25) g'n 



In this setting (22) holds iff 

{Lu^)n = —r^——r and {Lu^)n = -, n>2, 
n[n +1) n 

(26) (Ln")„ = (Ln-)„ = — ^— , n>2, 

n[n — 1) 

(LV)„ = — ^— -, n>3, 
n{n — 1) 

where L (resp. L') is the endomorphism of the vector space C2 (resp. C^) of 
real sequences indexed by N — {0, 1} (resp. by N — {0, 1, 2}) defined as 

n + 2 

{Lw)n = -b — —Wn+i + [b + c{n - 1) + d]wn 
n + 1 



(27) 



{n-2)(^c+ —^"^Wn-i, n>2, 



n + 3 

{L'w)n = -b ^ Wn+i + [b + c{n - 1) + d]wn 



n + 

/ d \ 

n > 3. 



(n -3)(^c+ Wn-i, 
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The following lemma ends the proof. 

Lemma 5.5 (Existence). There are solutions u'^ , , u°' , u"" , u"^ of (26) 
such that u^,u^,u°',u" and {nufj}n are bounded. 

This lemma will be proved in the following subsection by actually dis- 
playing explicit expressions for these solutions. □ 

5.4. Invasibility coefficients and adaptive slopes. In this subsection we 
give the explicit formulae for the invasibility coefficients g'' of Theorem 5.1 
and the adaptive slopes of (18). 

5.4.1. Preliminary results. For k > —2, let e^*^^ be the sequence defined 
forn > 2 (3 if /c = -2) by 



n + k 

and for /c = 2,3, let 5^^'^ denote the Dirac mass at k: 

1, iin = k, 
0, otherwise. 

Then it is elementary to check that, for k>\, 

(28) k k k 

+ {b-{k + l)c + d)e(^) + {k + l){c- ^ e^'^-i), 

and that 

(29) Le(-^) = -26e(°) + be^^^ + fte^"^) + (c + d)^^^) . 
Likewise, for any k>\ and for A; = — 1, 

(30) ^ ^ ^ 



+ {b-{k + l)c + d)e(*^) + {k + 2)(^c- 



and also 

(31) L'e(-2) = -2(6 + d)e(-i) + be^^^ + (5 + c + d)e(-2) + (^c + f ) J^^) . 

Next observe that (26) can be written in the form 

Lu^ = eW-e« and Ln^ = eW, 

(32) Ln" = Lu'" = e(-^) -e(°), 
^V = e(-^)-e(0), 
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SO it is likely that the u's can be expressed as linear combinations of the 
e'-'^^'s. Actually, we will show they can be expressed as such linear combina- 
tions, with a potential extra additive term whose image by L (resp. L') is 
proportional to 5^'^^ [resp. (5^^^]. So we end these preliminaries with display- 
ing two sequences: one in C2 whose image by L is J^^^ , and one in whose 
image by V is (5(3) . 

Assume that, at time 0, all individuals are assigned distinct labels. We 
denote by P„ the law of the logistic branching process (6, c, d) starting from 
n individuals distinctly labeled at time 0, where the label of an individual is 
transmitted to its offspring. In other words, under P, we keep track of the 
whole descendance of each ancestral individual. 

Then for /c = 2,3, let Tk denote the first time when the total population 
size (i.e., the unlabeled process) is k. Finally, we define 

:= Pn(at time T^, the k living individuals have k distinct labels). 

In the tree terminology, q^^^ is the probability that all individuals in the first 

(k) 

surviving A:-tuple have different ancestors at time 0. In particular, =1. 



Lemma 5.6. Let g and D^^^ G £3 he the sequences defined 

(2) 

K(n — 1) 

(3) 

"K'(n-l)(n-2)' 



as 



where 



d 

3 J ' 2V 2 y 2 

Then LD^"^^ = 5^^^ and L'D^^^ = 6^^'^ . 

Moreover, the sequences q^^^ satisfy the following property. 
Lemma 5.7. For any k>2, {q^^)n has a nonzero limit 

qoo as TL > 00 . 

Proofs of Lemmas 5.6 and 5.7 are put to Section 5.5.1. 

The next (sub)subsections are devoted to results related to invasibility 
coefficients and adaptive slopes, which prove Lemma 5.5. In Propositions 
5.8, 5.9, 5.11 and 5.13, we display the solutions of (26) such that n' (i^e) 
and {nu'^)n are bounded (therefore proving Lemma 5.5). We also specify 
the behavior of each invasibility coefficient as the population size grows to 
infinity. Proofs of Propositions 5.11 and 5.13 are to be found in Section 5.5.2. 
Proposition 5.14 gives explicit expressions for the adaptive slopes. 
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5.4.2. Results for the X-invasibility. Here, we must find a bounded se- 
quence in £2 such tliat Lu^ = e^'^^ — e^^^ . 

Recall from Lemma 5.6 that D^'^^ S £2 is a sequence such that LD^"^^ = 
5(2), and 

(2) 

where qh is the probability that the first surviving pair in the (labeled) 
logistic branching process {b,c,d) has two distinct ancestors in the initial 
n-tuple. 

Since, by (29), 

Le(-i) = -26e(0) + ^e^^) + be^-^^ + (c + d)<5(2) , 

and by (28), 

Le^^) = de(-i) + (-2c + d)e^^^ + 2(c - d)e^°^ , 
we can readily state the following: 

Proposition 5.8 (Fertility). The sequence defined as 

(33) = -4-e(-i) + + led) 

^ ^ 2bc 26c 2c 

is a bounded sequence of £2 such that Lu^ = e^^^ — e^) . Then the invasibility 
coefficient associated to fertility (g^ = nu^) is given by 

(2) 

A d{c + d)nqn n 

^ ' ^'^""26c(n-l) ^ 2bcK n-l + 2c(n + l)' " 

In particular, 

^ b-d + d{c + d)q^^ /k 

Imi q„ = . 

n^oo^" 26c 

5.4.3. Results for the a and a-invasibilities. Here, we must find bounded 
sequences u" and in £2 such that Lu" = Lu'^ = e^~^^ — e^^\ Exactly in 
the same way as for the A-invasibility coefficient, we can readily make the 
needed statement. 

Proposition 5.9 (Aggressiveness, survival). The sequences u" and u" 
defined as 

>o.^ ^a_.^<r_ ^^-d (-1) (2c-d)(c + (i) (2) 1 (1) 

^'^^^ 2bc ^ 26c ^ +2c'' 
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are bounded sequences of C2 such that Lu^ = Lu'^ = e^~^^ — e^''^ . Then the 
invasibility coefficients associated to aggressiveness (g" = nu") and survival, 
(gn= n-Un) ire given by 

(oa\ „a _ „<x _ (2c -d)n (2c -d){c + d) ngn'^ , n 
{6b) g^-g,^- ^^^^ n-l + 2c(n+l)' 

In particular, 

b + 2c - d - {2c - d){c + d)q^^ / K 



lim an = lim 5n 



26c 



5.4.4. Results for the 5 -invasibility. For 5 and e-invasibility coefficients, 
the task is mathematically more challenging. A side-effect is that we only 
obtain fine results in the case when the resident species has no natural 
death rate. This shortcoming is not very disturbing, however, because we are 
especially interested in precisely those populations with stationary behavior 
(which are those needed for applications to adaptive dynamics). From now 
on, we assume that d = 0. 

Recall that we must find a bounded sequence in C2 such that Lu^ = 
e(0). 

Lemma 5.10. Let ^ be the sequence of C2 defined recursively as $2 = 1 
and 

n — 2 

(37) c{n + 2)$„+i + [b- c{n + !)]$„ - b = 0. 

n—\ 

Then the sequence (n$„)„ converges to a nonzero finite limit ^00; '^'^'d the 
(thus well-defined) sum 

n>2 

has 3c — bS = c<I>oo • 

Proposition 5.11 (Defence capacity). Define the sequence (j) of C2 as 

Then, with (pi := l/2c, the sequence of C2 defined as 

k>l 

is a bounded sequence such that Lu^ = e^^^ . The invasibility coefficient g^ 
associated to defence capacity (g^ = nu^^) is given by 

(38) ""-i:^- "s^' 
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In particular, 



5r^~-ln(n) asn—^oo. 



The proofs of these results are given in Section 5.5. 

5.4.5. Results for the e-invasibility. Recall from Lemma 5.6 that D^^^ is 
a sequence m £3 such that LL>(3) = ^(3)^ and 

(3) 

r)(3) _ „ > Q 

~ K'{n-l){n-2y 

(3) 

where qh is the probability that the first surviving triple in the (labeled) 
logistic branching process {b,c,d) have three distinct ancestors in the initial 
n-tuple. Now as in the previous problem (J-invasibility), we assume that the 
resident species has no natural death rate, that is, d = 0. 

Here, we must find a sequence in £3 such that {nu'^)n is bounded, and 
L'u" = e(-i) - e(0) . Recall d = b/c. 

Lemma 5.12. Let ^ be the sequence of defined recursively as ^3 = 1 
and 

^ 

(39) c(n + 3)^'„+i + [b- c{n + 1)]^'„ - b = 0. 

n — I 

Then the sequence (n^^„)„ converges to a nonzero finite limit ^00, and the 
(thus well-defined) sums 

5" := ^ n~^^.„ and T,:=^^n 

n>3 n>3 

have 

S + 205 = ^'oo + (^-3)S = 5. 
Proposition 5.13 (Isolation). Define the sequence i/j of C3 as 

'lpn-=-'^n/c^OD, n>3. 



Then, with 



1 



6(0 + 3) 

e+i 



b[e + ?,y 
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3c(0 + 3)' 
S 26* + 3 



c^oo 3c{d + 3) ' 
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the sequence of £3 defined as 



fe>-2,fc^0 ^(^ + 3) 



is such that {nu^)n is bounded and L'u^ = — e^^\ Then the invasibility 
coefficient associated to isolation (g^ = n^u^) is given by 

^ ^ ^" " ,>_4:,^o " + ^ '^'^(^ + 3) (n - l)(n - 2) ' " " 



/n particular, 



gli^ — ln(n) as n—>- 00. 



The proofs of these results are given in Section 5.5. 

(2) 

5.4.6. Adaptive slopes. We will denote by qn (x), k{x) and (/)n{x) the 
quantities appearing in Propositions 5.8, 5.9 and Proposition 5.11 when the 
resident population has trait x [and dynamical characteristics {b{x),c{x, x),0)]. 

The adaptive slopes appearing in the deterministic part of the canonical 
diffusion (15) can be expressed as follows. 

Proposition 5.14. The coefficients for L = X,5,a can be expressed 

(2) 

in terms of the microscopic parameters b{x),9{x),qn ' (x), k{x) and ipnix) as 



(41) ax{x) 
aa{x) 

(42) 



eSi^)(e{xf - 3e{x) + 4) - e{x) - 4 
2b{x)e{x)'^ ' 

e^(^)(0(x)2 - d{x) + 2) - d{x) - 2 
2b{x)e{x)^ 

1 g nq^^l,{x)e{xr-^ 



K{x)e{x)^^ {n + iy. 



(43) «.(-) = E^//-^-HeV-n + l) 



.>1 ^(-) 
1 /-eCx) 



(44) -« + !)- IK (; 

where for k>l, 

f u^-^ie'^iu^ -u + l)-l)du 



u 



l)du 



du, 
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^^•+1 _ (A, + 2)9'^ + ik + if{k - 1)1 y: j^zr—Y)]) 

_(_l)fc-i(A; + i)2(fc_i)!_^ 

k 

and for any v € [0, 1), iTxiv) := J2k>i (t^k{x)v^~^ . Moreover, tTx is solution on 
[0,1) to 

6(x) 

(46) u^n - u)tt''(u) + u(9(x)u(l -u) + 2- 3u)7r'(u) - 27rJu) + -f^ = 0. 

b{x) 

Proof. It follows from Proposition 5.8 that 

n0(x)"-i 



«A(a;) = J2 



2c{x,x){n + 2){n + l)(n - 1)! 
and from Proposition 5.9 that 

e(x)"-i 



^^6(x)(n + l)(n-l)! 
+ E 



2c{x,x){n + 2){n + l)(n - 1)! 

^ gi^|i(x)g(x)-i 
;^^6'(x)K(x)(n + l)(n-l)!' 



Elementary calculations then give (41) and (42). 

For the (5-invasibility, using Proposition 5.11 and switching the two sums, 
we get 



k>l n>l 

The following observation 



1 



du\ du\ u 
e"(n2 -u + 1) - 1 



yields (43). Equation (44) follows from switching the sum and the integral 
in (43), which is standard since 4>n{x) = 0(l/n). 
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Equation (45) can be checked using the fact that e^{u^ — ku^~^ + k{k — 
l)u^~'^ H h (— is a primitive of e"n^. 

Finally, (46) can be deduced from the facts that (/>i(x) = l/2c{x,x) = 
e{x)/2b{x) and 

n — 2 

Vn > 2 (n + 2)</.„+i(x) + {e{x) -n- l)(^„(x) - e{x) -(kn-i{x) = 0. 

n—\ 

Multiplying these equations by (n — l)x'^~^^ and summing over n>2 yields 
= Y^{n+l){n- 2)</.„(x)n" + ^(x) ^ (n - l)0„(x)7x"+^ 

n>3 n>2 



^(„ + i)(„ _ l)</>„(2;)n"+i - 9ix) J2{n- !)</<„ (x)n"^ 



1+2 

n>2 n>2 



du\ du\ u 
+ 6{x)u'^tt'^{u) - M^(n^<.(u)) - e{x)u'^TT'^{u), 

which finally gives (46). □ 
5.5. Proofs. 

5.5.1. Proofs of Lemmas 5.6 and 5.7. 

Proof of Lemma 5.6. It is quite elementary to check the result by 
standard applications of the Markov property under P, but we prefer to 
give a more conceptual proof. We start with D^'^\ 

Under P, we only keep track of two types at time t, that is, the number 
Xt of residents, and the number Yt of mutants, whereas under P„, there 
are n types at time 0, say, l,2,...,n. Recall individuals of all types are 
exchangeable (because in this setting, the discrete operators Aq and L are 
associated to selective neutrality). Set 

Wn^m ■■= Fn,m{XT2 = Yt^ = 1). 

Now, by exchangeability, 

n n+m 

Wn,m = ^ ^ Pn+m(at T2, type i and type j have one representative each) 

i=l j=n+l 

= nmPn+m(at T2, type 1 and type 2 have one representative each). 
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and once again, by exchangeability, 

— 5Z type i and type j have one representative each) 

l<i<j<n 

2^ Pn(at T2, type 1 and type 2 have one representative each). 
As a consequence, 

2nm (2) 



w 



n,m 



{m + n){m + n-iy'^+'^' 

Observe that by definition w is harmonic (in the sense that Aqw = 0) on 
the complementary of U $72 U {(1, 1)}. Then as in the previous subsection, 

with Vn = qk / {n — 1), we get that {Lv)n = for any n > 3. The proof is 
completed by checking that {Lv)2 = k^O. 
As to set 

= 2P„,„((Xt3,1t3) = (2, 1)) - 2Fn,m{{XT,,YT,) = (1,2)). 

Now, by exchangeability, 

p„,^((XT3,yT3) = (i,2)) 

n n+m 

= ^ ^ P„+m(at Ts, type i has one representative 

2=1 j=n+l 

and type j has two) 
+ ^ ^ P„+m(at T3, types i, j and /c have 

l<i<n n+l<j<k<n+m 

one representative each) 
= nmP„+m(at T3, type 1 has one 

representative and type 2 has two) 
m(m — 1) 

+ n P,i_|_m(at 13, types 1, 2 and 3 have one 

representative each). 

Since P„,^((Xr3,lT3) = (1,2)) = P^,„((Xr3,FT3) = (2,1)), the correspond- 
ing first terms in the difference cancel out, and we are left with 

'Wn,m = nm(n — m)P„_|_m(at Ts, types 1, 2 and 3 have one representative each). 

But again we get an expression involving the last displayed probability as 

q^^ ~ ( 3 ) -^"(^^ -^3' *yP^^ 2 and 3 have one representative each). 
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SO that 

6nm{n — m) (3) 
[m + n)[m + n — l)[m + n — 1) 

This time w is harmonic on the complementary ofr2iUil2U{(l,l),(l,2),(2,l)}. 

Then with t;„ = Q'n ~ ~ 2), we get that {L'v)n = for any n > 4. 
The proof is completed by checking that {L'v)^ = k' ^0. □ 

Proof of Lemma 5.7. From [23], we know that 00 is an entrance 

(k) 

boundary for the probabilities P^, n > 1, so that Poo and goo are properly 
defined for any k > 1. At time t, we denote by Zt the number of living 
individuals and by Nt the number of types represented. Obviously, under 
Poo, — > 00 as t — > 0+. As to N, since it is a nonincreasing function of 
time, it has a right-limit A'^o^ < cx3 at t = 0. Next we want to show that for 
any ko > 2, 

(47) qt^ = =^ Poo(Ao+<A;o) = l. 

This will end the proof of the lemma. Indeed, Ao+ < ko means that, under 
Poo, there are at most /cq individuals whose total descendance at any time 
t is Zf. Then, conditional on these individuals, Z would be dominated by a 
binary logistic branching process starting at /cq, which contradicts the fact 
that Zo+ = +00. Conclude by summing over all possible fco-tuples. 

Now, we prove (47). Assume there is fco > 2 such that q^"'^ = 0. Since for 

k>ko, qli°^ > qn\l^°\ we get that q^^ = for all k>kQ. Recall that Tj is 
the first hitting time of j by Z. For n> j > k > ko, 

qi'^>Pn{NT,=k,NT, = k) 

>Pn{NT,=k)C{j,k), 

where C{j,k) is the probability that, conditional on Tj = k, after picking k 
representative individuals at Tj (one for each type), the first j — k events 
after Tj are the deaths of all nonrepresentative individuals. Because this 
probability only depends on j and k, we get that Poo(A^7^^ = k) = for all 
j > k>kQ. As a consequence, 

Poo(A^T, <A:o) = l. 
But under Poo, limj^ooTj = a.s., so that Poo(Ao+ < A:o) = 1. □ 

5.5.2. Proofs for 5 and e-invasibilities. 

Proof of Lemma 5.10. The proof stems immediately from the two 
following claims. Claim 1 will also be helpful in the proof of Proposition 
5.11. □ 
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Claim 1. Assume that converges to a finite limit ^oo, where 

{^n)n is defined in (37). Then the real number S := J2n>2^~^^n md the 
sequence := X]fc>2 '^fc^^*^^ of C2 are well defined, and 

(i) c$oo = 3c-6S, 

(ii) LW = c^ooe^^\ 

Claim 2. The sequence {n^n)n converges to a nonzero finite limit. 

Proof of Claim 1. To prove (i), let 

(48) /3„:=(n + l)^>„ and 7„ := (n - 1)$„, n > 2, 
so that 

lim I3n = lim 7„ = $oo, 

and, thanks to (37), 

Q 

(49) Pn+l-fin = -(7n-7n-l), « > 2, 

n—1 

with 7i =0. As a consequence, by Abel's transform, we get 
^ \n-l n ^ 77,-1 

n>2 n>2 



= -e-^ (f^n+l - (3n) = -0-\^oc - P2) = (3 - '^00) /O. 
n>2 

As for (ii), thanks to (28) and (29), and by continuity of linear operators, 
I 

LW = hrn ^ <^kLe^'''> 

b /u ,k-l 



i^ocf-' k k 

k=2 

+ [b-{k + l)c]e(*^) + (A; + l)ce('=-i) j 

- lim I -b(y k~'^k] e^'^ - by ii:^$,_ie« 



+ y[b-{k + l)c]$fce(^) + 5] c(j + 2)$,+ie(^) 

fc=2 j=l 
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■'"1' k-2 



.k=2 



1-2 



- 6^^$je('+^) + [h-{l + l)c]^i + 3c$2e(^) | 



= (3c-65)e(^\ 
which ends the proof. □ 

Proof of Claim 2. We spUt this proof into the four following steps 
[recall (48)]: 

(i) if (?i<&n)n converges to a finite limit $oo) then $oo 7^ 0, 

(ii) (/3n)n has constant sign for large n, 

(iii) (/3n)n is bounded, 

(iv) {f5n)n converges. 

Since we are only interested in the asymptotic properties of the sequences 
(^n)n, (/?n)n and ['^n)ni we will implicitly assume throughout this proof that 
e/[n + l) < 1, that is, n>9. 

(i) If $00 exists, then thanks to Claim 1, we can define W = J2k>2 ^k^^^^ 
and the doubly indexed sequence w as 

TlTTi 

Wn,m = — Wn+m, (n, m) G N X N \ (0, 0) . 

n + m 

Because W is bounded, w is sublinear. Assume = 0. Then by Claim 1, 
LW = 0, and the same calculations as those yielding (26) and (27) show that 
Aqw = 0. The contradiction comes with Lemma 5.4, which implies that the 
null sequence is the only sublinear doubly indexed sequence which vanishes 
on Oi U 0,2 and is in the kernel of Aq. 

(ii) First observe that (37) reads 

(50) Pn+l=(l--^)f3n+0^^^^f3n-l, 

V n + 1/ n(n — Ij 

so if there is no > ^ such that (3noPno-i ^ 0, then a straightforward induction 
shows that {Pn)n>no never changes sign. Now, we prove that if no such uq 
exists, then (/3n)n converges to 0, which contradicts (i). Indeed, assume that 
for all n>9, f3nPn-i < 0. Then for any n> 6 + 1, if Pn-i < 0, then > 
and Pn+i < 0, so that 

n + lj n[n — 1) 
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which can be written as 

n+1 J n[n — 1) 

and we would get the same inequahty if (3n-i > 0. This would imply that 
|/3n|/|/3n-i| would vanish as n grows, and so would 

(iii) Without loss of generality, we can assume thanks to (ii) that there 
is no such that /?n ^ for all n > no (otherwise change P for — /?). Next, we 
prove that, for all n > no, Pn+i < niax(/3„, It is then elementary to 
see that (/3n)n is bounded. First check that 

Pn+l - Pn = riPn - Pn~l) - 20— r ^-^^ — — r, 

n — 1 n(n — lj(n + 1) 

so for any n > ng , 

Q 

— Pn< riPn — Pn-l)- 

n — 1 

In particular, if /3„+i > then /3„ < f3n-i, and 

Q 

\Pn+l — /3n| < rlPn — Pn-ll < \Pn — Pn-ll, 

n — 1 

which reads Pn+i — Pn < —Pn + Pn-i, that is, Pn+i < Pn-i- As a conclusion, 

Pn+l < I3n or (3n+l < Pn-l- 

(iv) By (49) and Abel's transform, we get 



n-1 

In ^ ^ Ik 



and the r.h.s. converges, because (7n)n is bounded, thanks to (iii). □ 
Proof of Proposition 5.11. Thanks to Claim 1 above, since = 

= (2c)-i(-2ce(i) + 2ce(°)) + (c$oo)~^c$ooe(^) 
= eW. 

The boundedness of is straightforward. To get the equivalent of gf^ as 
n — > oo, it is sufficient to prove that nWn ~ $ooln(n). First, starting over 
from the proof of Claim 2(iv) above, get that 

^oo-/32 = -0Er7rNT' 
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SO that 

which imphes that /3„ — ^>oo = o {n~^). Next, writing := k^k: we get 



l^^^Hn + k) \k n + k 

{n+l I l+n ~1 

E Pk — 1*00 g'oo Pn+fc — Pfc 

k=2 ^ k=2 ^ k>2 ^^'^ 

= $ooln(n) + 0(l), 

where the last equation comes from the fact that = + 0{k~^) as 
A; — > oo. □ 

Proof of Lemma 5.12. Since proofs for the isolation e are quite similar 
to those done for the defence capacity 5, we will often sketch them. The proof 
of Lemma 5.12 stems immediately from the following two claims. □ 

Claim 1. Assume that (n^^n) ^ converges to a finite limit ^oo, where 
{^n)n is defined in (39). Then the real numbers S := X]n>3'^~"^^" ^'^^ ^ 
J2n>3^n, as well as the sequence Z ■.= J2k>3^ke^''^ of are well defined, 
and: 

(i) S + 2^5 = ^'oo + (0-3)S = 5. 

(ii) -Se(2)) = 0^500(6(2) -e«). 

Claim 2. The sequence {n'^'^n)n converges to a nonzero finite limit. 

Proof of Claim 1. To prove (i), let 

(51) /?„ :=(n + 2)(7i + l)^'„ and 7„ := (n - 2)(?i - 1)^'„, n > 3, 
so that 

hm /3„ = lim 7„, = -^oo, 

n— >oo n— >oo 

and, thanks to (39), 

(52) = - ^^^ + ^) (^,-^,_i), n>3, 

[n — l)(n — 2) 
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with 72 = 0. As a consequence, by two applications of Abel's transform, we 
get 

1 1 



n>3 n>3 



n+1 n+2 



/I ^ n _L 9 ^ 



4 n + 2 z_.(n-l)(n-2) 



n>3 n>3 

n{n — l)(n — 2) 



?i>3 

= 5 - 205. 

On the other hand, the same type of arguments as above show that 
(n-2)(7i- 1) n-2 

Ti>3 ^ ' ^ ' n>3 

n>3 

,if/?3 v-^/n-2 n-1 

= -e-^(-5 + ^oo-3S), 

which ends the proof of (i). With the help of (30) and (31), (ii) can be proved 
easily mimicking what was done for the (5-invasibility. □ 

Proof of Claim 2. We proceed just as for the defence capacity. First, 
we prove that if ^'oo exists, it cannot be 0. Indeed, consider S and Z S £3 
defined in Claim 1, and further define 

nm(n — m)/ S \ , ^ ^ ^ 

Zn,m = ^ -{Zn+m ] , n, m G N* X N\ 

n + m V n + m + zj 

Because {nZn)n is bounded, z is sublinear. If ^'oo = 0, then thanks to Claim 
1, we would get Aqz = 0, but this would contradict Lemma 5.4. 
Next recall the sequences /3 and 7 defined in (51). Thanks to (39), 

which proves that /?„ has constant sign for large n, otherwise it would con- 
verge to [and then = 0, which would contradict (i)]. Therefore, we can 
assume that /3n ^ for large n without loss of generality. Since 

/?n+l - /3n = r~:i(^n - l^n-l) - ^0— — — — , 

n + 1 n{n — l){n + \) 
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then for any sufficiently large n, < (3n+i < iiiax(/3„, so that {(3n)n is 
bounded, and so is (7n)n- Use (52) to show that 

n + 2 " ""^ k + 6 

Pn^i - A = -^(„_i)(^_2)^« - ^ E A:(fc-l)(A:-2)^^' 

and conclude that {j3n)n is convergent. □ 

Proof of Proposition 5.13. Recah Z defined in Claim 1 and set 
V32 := -(261 + 3)/3c(6l + 3), as weU as F € /:3, 

V := V'-2e("^) + ^-ie(-^) + V'le^^) + ip2e^^\ 

so that 

(53) «^ = -{c^oo)-HZ - Se(2)) + y + j^^^D'-'^. 

By an elementary computation relying on (30) and (31), get 

C^(y + 3) 

and conclude, thanks to Claim 1, that L'u^ = e^~^'^ — e^^\ 

To get the equivalent of gi^ as n — oo, first recall (53) and observe that 

■0-2 + V'-l +tpl + ^P2 = 0, 

SO that (nV„) n converges. Next consider nZn- 



^- = \^ k^^f^ 

n + k f-1 \k n + k 



fc>3 " + ^ 



n \ n 

by a similar method as in the proof of Proposition 5.11. As a consequence. 



nu. 



ln(n) ^ /ln(n)' 



cn 



which ends the proof, since = n u'^. □ 
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6. Proof of the convergence to the TSS and the canonical diffusion. 

6.1. Preliminary result. We start this section by stating and proving a 
technical proposition about the two type particular case without mutation 
{fi = 0) of the GL-population of Section 2.2. In the case where vq = Xq6x + 
Yody, for any t > 0, ft = Xt6x + Yt5y. Then, the Markov process {Xt,Yt; t>0) 
satisfies the following properties. 

Proposition 6.1. 

(a) Let (X„,i^;nGN) denote the discrete-time Markov chain associated 
with {Xt,Yt;t >0) , and T denote the first hitting time of Vti\jVt2 by iX,Y). 
There is some positive constant C independent of x and y such that 

(54) IE„,,„(r) < C(n + m) and E„,,„(f 2) < C{n + mf. 

(b) Kn^rn{X^ + Y^) < C{n + m)^ for some constant C independent of x 
and y. 

(c) With the notation of Section 4.1, when the birth rates b{x,y,n,m) 
are multiplied by a positive constant a, the fixation probabilities Un,m <ire 
continuous as a function of a. 

Proof, (a) The process {Xn + Yn;n £ N) is dominated by the Markov 
chain n G N) in N* with initial state k = Xq + Yq and transition proba- 
bilities 

r6/[6 + c(i-l)"], if i>l and j = i + l, 

Pij = \ c(i-l)"/[6 + c(i-l)"], if i>2 and j = i-l, 
1 0, otherwise. 

Let us denote by Pk its law. Therefore, T is dominated by S := inf{?i > 0, 
Zn = 1} and it suffices to prove that Ek{S) < Ck and Ek{S'^) < Ck^ for some 
C>0. 

Let {Un]n > 0) be the discrete-time random walk on Z with right transi- 
tion probability 1/3 and left transition probability 2/3. The law of U con- 
ditional on Uo = k is denoted by Pk- Let r be the first hitting time of by 
U. For any A; > 0, one can compute explicitly (see, e.g., [30]) that 

Eki'T) = 3fc, Ekir'^) = 3k{3k + 8) and Ek{ex.p{pT)) = exp(crpfc) 

for < p < ln(9/8)/2 with exp(cjp) = (1 - ^/l - 8exp(2_p)/9)3exp(-p)/2. 

Now, let ko be large enough to have c(fco — 1)° > 26. First, observe that 
any excursion of Z above /cq + 1 is stochastically dominated by an excursion 
of the random walk U above ko + 1. Second, let 

S' := inf{j > ko : Zj = 1, Zj_i = 2,..., Zj_ko = ^0 + !}• 
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Obviously, S < S' . Moreover, for any n such that Zn = ko + 1, S' = n + ko 
with probabihty (3 := Pko+i,ko ' ' 'P2,i > 0, and otherwise, Zn+ko ^ 2A;o + 1. 
Therefore, under P^, S is dominated by 

G 

TO + ^iko + Ti), 
1=1 

where G,tq,ti, . . . are independent, tq has the law of the first hitting time 
of /eq + 1 under -Pfcv(fco+i)' G is a geometric r.v. with parameter /?, and the 
Tj's are i.i.d. r.v. distributed as the first hitting time of /cq + 1 under -P2fco+i- 
Therefore, if p is small enough to have (1 — /3) exp(A;o(p + < 1 (observe 
that Up — > when p^O), then 



1 ^ i>i 
Therefore, there exists C, p, a > such that 

(55) Ek{eP^)<Ce''^. 
Moreover, for any k>kQ, 

Ek [S] < Ek, (5) + Ek-ko {r) = Ek, (5) + 3(fc - fco) 

and 

Ek{S^) < 2Ek,{S^) + 2Ek-ko{r^) = 2Ek,{S^) + 6{k - ko){3{k - ko) + 8). 

Since Ekg{S'^) < oo by (55), this ends the proof of (54). 

(b) With the same notation as above, since T is the number of jumps of 
the process {X,Y) that occurred on the time interval [0,T], Xt < Xq + T 
and Yt <Yo + f. Hence, E„,m(-^T + ^t) ^ 2E„,m((ra + m + f )2) and the 
required bound follows from (a). 

(c) Let us only denote the dependence of the fixation probability in a by 
Un,m{o.), and let us denote by nij{a) the transitions (10) of the Markov chain 
{X,Y) when b{x,y,n,m) and b{y,x,n,m) are replaced by ab{x,y,n,m) and 
ab{y,x,n,m). It suffices to prove that Un,m{ci) is continuous at a= 1. 

We will use the notation ■ni^^...^i^ (a) for the product TTjjjj {0)^^121^ (o) ' " ' '^ik-ih 
and S(^n,m)-*r foi' the set of paths linking (n, in) to a subset F of without 
hitting r^i U before T, that is, the set of all /c-tuples {11,12, ■ ■ ■ ,ik) for all 
k>l such that ii = (n, m), Z2, • • • , ik-i € \ (^^i U r22) and ik € F. Now, 

Wn,m(a)=E E 7rij,...,i^(a), 

fc>2 (n,...,ifc)eS(„_„)_ni 
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so it is sufficient to prove that the previous series (in A;) is uniformly con- 
vergent for a in some neighborhood of 1. 

Fix i = {n,m) and j S such that ||z — j|| = 1, where || • || denotes the 
norm in 7?. It is elementary to check that 7rjj(a)/7rjj(l) < (a V !)/(! + 
(a - l)c„,m), where Cn,m = Bn,m/ {Bn,m + Dn,m) with Bn,m = nb{x , y , Tl, m) + 
mb{y,x,m,n) and Dn^m = n'd{x,y,n,m) + md{y,x,m,n). Because of the 
bounds we assumed on b and d (Definition 2.1), the Cn,m are bounded by 
some constant C. Then, if \a — 1\C < 1/2, we finally get TTij{a) < 2(a V 
l)TTij{l), which implies the required uniform convergence. □ 

6.2. Proofs of Theorems 3.1 and 3.2. Recall from Section 3 the definition 
of the stopping times t„ (nth mutation time) and p„ (first time after t„ when 
the population becomes monomorphic) and of the random variables Vn (the 
surviving trait at time /9„). Recall also the notation b{x,n) = b{x,n6x) for 
the birth rate of an individual of trait x in a monomorphic population made 
of n individuals of trait x. 

The proof relies on the following three lemmas. The first one states that 
there is no accumulation of mutations on the timescale t/'j. The second one 
gives the limiting laws of jti and of the population size at time ti. The last 
one gives the behavior of po and Vq when the initial population is dimorphic. 

Lemma 6.2. Fix C, > 0. There is e > such that, for any 7 E (0, 1), 

(56) E{{i^Ll))<C =^ Vt>0 pfaneN*:- <r„ < <r?. 

V 7 7 / 

Moreover, for any r] > and t >0, there exists n G N* such that, for any 
7G(0,1), 

(57) E((z/oM))<C =^ P(t„ < t/7) < r?. 
Lemma 6.3. Assume = n5x where fi{x) > 0. 

(a) As ^^0, the pair {jti, converges in law to a couple of 
independent random variables (T, N), where T is an exponentially distributed 
random variable with parameter [3{x) defined in (8), and the law of N is 
obtained by b{x, ■)- size- biasing ^{x): 

(58) r(- k) >'b{x,mC{x) = k) 

(b) Foranyp>l, sup^g(o,i) E;^5^((z^ri , 1)^) < 00. 

Lemma 6.4. Assume z/q = n5x + 6y (with y ^ x). Then: 
(a) 7po — > m probability and P'^(po < ti) ^ 1 as 7 — > 0. 
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(b) sup^g(o,i)ET((i/;^^,l)2l|^^<^^}) <oo. 

(c) lim^^oIP^(^o = y) = l- lim^^oIP^(Vo = x) = u„,i(x,y). 

Proof of Lemma 6.2. Fix C > and assume E((z^(]',l)) < C. By 
Proposition 2.3, there exists a constant C" such that E((f^,l)) < C" for 
any i > and 7 > 0. Therefore, it is sufficient to show (56) for i = 0. 

Now, when the total population size is n, the total mutation rate in the 
population is bounded by 76^, so that the number of mutations Mt be- 
tween times and t is dominated by a Poisson point process with intensity 
'yb{i>s,l) ds. Therefore, 

P(M,/^ > 1) < E(M,/^) < 76 r^\{{iy], 1)) ds < ebC, 



which concludes the proof of (56). 

Similarly, for t > 0, P(Mt/^ > n) < tbC'/n, which implies (57). □ 

Proof of Lemma 6.3. Fix 7 e (0, 1) and assume that = n5x- Recall 
that Ti is the first mutation time. Notice that {fi'^t < ri) is distributed as 
{X^5x',t < r), where X'^ is a birth-and-death process with initial state Xq = 
n and transition rates (1 — jfi{x))ib{x, i) from i to i + 1 and id{x, i) from i to 
i — and r is the first point of a Poisson point process with inhomogeneous 
intensity g'^^X^) := 'yij,{x)Xfb{x,Xf) (depending on X"' solely through its 
intensity). Therefore, for any bounded function / : N* — >■ R and for any t > 0, 

(59) E^(/((i.7/^, l));7n > t) = e[/(XJ^) exp(^- jl'\\X]) ds^ 
and 

which yields, after a change of variable, 
E^(/((z.,V,l))l|,,^<,}) 

(60) 

= ^,{x) f E(/(Xj/^)Xj/^6(x,Xj/^)e-^^(-)/;'^"^(-'^")'^")d.. 



Now, since the individual birth rates of X'^ decrease with 7, all the pro- 
cesses X"' can be constructed on a same space in such a way that, for 
< 7 < 7' < 1 and i > 0, x/ < X^ < X^. 

To compute the limit of (60) when 7 — 0, let us first prove that 

*E(ffi(Xj/^)e-^/o''^^(^")'^")d. 



lim 

(61) 



E(5i(X,%)e-^/o''^^(^°)'^")d. 
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for any functions gi and §2 on N such that < Cx and < 52(2;) < Cx. 

For M > 0, this quantity is bounded by 

j\\gi{X]^^)-gi{X''^/^)\ds + C j\ j^'\{Xl^\a2{XZ) - g2{Xl)\) duds 

<2Cj nX^;Xli^X2)du 
Jo 

+ 2C' 7 /^^^ IE(XJ/^X0; / du ds 

< +2C77 / [IE(XO; > M) + MP(XO < M, X^ + Xl)\ du 
Jo 

+ ME(XJ/^; < M, X^ + Xl)\ du ds. 

Therefore, by Proposition 2.3, using the Cauchy-Schwarz inequahty to bound 
the term involving K{X'^^_^X^; X^ > M) and distinguishing between ^2/^ < 

M and X]^^ > M in the term involving E{X]^^-X^ < M,X^^ X:^), it is 
sufficient to prove that 

hm 7 t^' nX^u <M.Xl^ XZ) du = 
7^0 Jo 

or, equivalently, that 7 times the expected time length between and t/^ 
where X ° < M and X° / XI goes to 0. 

Since the difference between the birth rates of X^ and X^ when X^ = 
XZ is less than jbX^, any time when the two processes can start to differ 
belongs to the set of times when a point of a Poisson point process on 
with intensity jbduds independent of lies below the curve {t,X^)t>o. 
For each of these points, the time length where the two processes differ 
is dominated by the first hitting time of 1 by X^ (at this time, the two 
processes are necessarily equal). Since, moreover, we only have to consider 
the time intervals where X^ < M, all these time lengths are dominated by 
independent realizations of the hitting time of 1 by X^ starting from M. 

Let denote the number of points of the previous Poisson point process 
below X^ before time t/j and let (Rk) be a sequence of r.v. independent of 
n-y distributed as the hitting time of 1 by X^ starting from M. Then 

7/ F{Xli<M,Xli^X2)du 
Jo 
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which goes to as 7 ^ by Proposition 2.3. 

Therefore, (61) is proved. Combined with (60), we get 

limE^(/((i.;„,l))l{^,^<,}) 

Since X^ is exactly the positive-recurrent Markov chain mentioned at the 
end of Proposition 2.2, apply the ergodic theorem to get that 7 Jq^"' X^b{x, 
X^) du ^ sK{^{x)b{x,^{x))) a.s. as 7 — > 0. Since supf>oIE((^f')^) < 00 and 
by Lebesgue's theorem, we finally get 

limE^(/((z.7^_,l))l{^,^<,}) 

= fi{x) rE(/(e(x))C(x)6(x,e(2;))e-'^(^)^[«(^)^(^'«(^))l^) 
Jo 

_ E(/(C(x))g(x)b(x,g(x))) . ^ , 
- E(C(x)6(x,e(x))) Jo'^' 

which completes the proof of Lemma 6.3(a). 

Lemma 6.3(b) can be obtained by taking f{x) = x^ A K in (60), then 
letting first K go to infinity and next t to infinity. Then, we get that 

KsM^r, > 1)") < b E [(^J/,)^+^ exp (-7/i(x) fj' Xlh{x, X^) du^ 

_ roc 

< h / E[(Xj/^)P+i exp(-7^(x)6(x, 1)L,/^)] ds, 



where Lt = /q 1|_yo=i} du. By the ergodic theorem for X^ , Lt/t converges a.s. 
as t — > 00 to a positive nonrandom limit I. However, we need a finer result 
to conclude. Fix A > 0. Distinguishing between L^j^ < As/7 and Lg/^^ > 
As/7 using the Cauchy-Schwarz inequality and Proposition 2.3, one 
can bound from above the last displayed integral by a constant times 
— ) 

[P(L,/^ < As/7)^/2 _^ exp(-/i(x)6(a;, l)As)] ds. 



ds 







Therefore, it suffices to prove that there exist A, A',C > such that ¥{Lt < 
Xt) < Ce"^'* for any t > 0. 

Now, define recursively to = 0, and for i > 1, Sj = inf{s > ti^i : X^ = 1}, 
ti = inf{t > Sj : Xg = 2}. Then for i>l, set Tj := tj — Sj and Si := Sj — ti-i. 
By the strong Markov property, all these r.v. are independent, and more 
specifically, (Tj)j>i are i.i.d. exponential r.v. with parameter b{x, 1) (the 
jump rate of X^ from state 1), {Si)i>2 are i.i.d. r.v. distributed as the hitting 
time of 1 by the process X^ started at 2, whereas Si is the hitting time of 
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1 by the process started at n (remember that n has been defined by 
uo = n6x)- Then, for any p,a > 0, using Chebyshev's exponential inequality 
to get the last line, 

Ck fc+1 \ 

3k > 1 :"^Ti < Xt and ^iSi + Ti)>t\ 
i=l i=l ) 

I k fc+1 \ 

< P 3fc > 1 i^Ti < \t and T^+i + ^ 5i > (1 - A)t 

\ i=l i=\ / 

oo / fc \ / fc+1 \ 

< ^pK^T, < At P Tfc+i + ^ 5. > (1 - A)t 



fc=i 



\i=l 



i=l 



fc=i 

Observe that E(exp(cjri)) = b{x, l)/{b{x, 1) - a) if a < b{x, 1). Therefore, if 
we can prove that there exists a > such that E(exp(a"5'i)) < oo [and thus 
E(exp((TS'2)) < oo], then p can be chosen large enough to have E(exp(— pTi)) x 
E(exp(crS'2)) < 1, and next A > can be chosen small enough to have p\ — 
a{l — A) < 0. This would end the proof of Lemma 6.3(b). 

Therefore, it only remains to prove that there exists a > such that 
E(exp((T X Si)) < oo. This can be done as follows. Let be the discrete- 
time Markov chain associated with X^ and let be the holding time of 
X^ in the state X^. Let also Si be the first integer k such that X^ = 1. 
Then, for any k, Uk is dominated by an exponential r.v. with parameter 
K := b{x, 1) V c, which is a lower bound for the jump rates of X^. Therefore, 
if a < K and {Ri)i>i denote i.i.d. exponential r.v. with parameter k, 



E(e'^^i ) < E l^exp (^cr E ) 



F{Si = k) 



:E 



K — a 



which has already been proved to be finite for small enough a in (55). □ 



Proof of Lemma 6.4. 



Before the first mutation, Uf 



where {X^ ,Y^) is a two-type GL-population with transition rates 



X^6x + Y,^6y, 



' {l-jp{x))nb{x,y,n,m), 
{l-'yn{y))mb{y,x,m,n), 
nd{x, y, n, m), 
mb{y, x, m, n), 

10, 



from (n,m) to {n+ l,m), 
from (n,m) to (n,m+l), 
from (n,m) to (n — l,m), 
from (n,m) to (n,m — 1), 
otherwise. 
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On the event {ri > po}, Vq = y if and only if there is fixation in this process, 
Vq = X otherwise, and po equals the fixation time T (see Section 2.2.2). 

Now, by Lemma 6.2, for any rj > 0, there exists e > such that P(ri > 
s/t) — Since ¥n,i{T < oo) = 1, this implies easily (a). It is then elemen- 
tary to deduce from Proposition 6.1(c) that (c) holds. Finally, (b) follows 
from the observation that 

En5.+5,((^;„, l)'l{po<n}) < E„,i((X?)2 + {Y^f) 
and from Proposition 6.1(b). □ 

Proof of Theorem 3.1. Observe that the generator A of the process 
S, defined in (7), can be written as 



(62) A(f{x)= / {(f{x + h)-(p{x))p{x)K{x,dh), 

Jx 

where /3(x) has been defined in (8) and where K,{x,dh) is the probability 
measure on ^ — x defined by 

.(X, dh) = f (X, X + h)^^^I^^^^^Mix, dh) 



n=l 



(63) + ( / 5](l-n„,i(x,x + y)) 

nb(x,n)P(^(x) = n) „^^ 

This means that the TSS model S with initial state x can be constructed as 
follows: let [U (fc). A; = 0, 1, 2, . . .) be a Markov chain in X with initial state x 
and with transition kernel K{x,dh), and let {P{t),t > 0) be an independent 
standard Poisson process. Then, the process {St,t> 0) defined by 

t 



St = Uop(^J^ (3{Ss)ds^ 



is a Markov process with infinitesimal generator (62), cf. [10], Chapter 6. Let 
{Jn)n>i denote the sequence of jump times of the Poisson process P and 
define (T„).„>i by J„ = /q " f3{Ss) ds or r„ = oo if P{Ss) ds < Jn- Observe 
that any jump of the process S occurs at some time Tn, but that all T„ may 
not be effective jump times for S, because of the Dirac mass at appearing 
in (63). As will appear below, the sequence (T„) can be interpreted as the 
sequence of mutation times in the limit process. Whether an effective jump 
occurs at time T„ or not then corresponds to the fixation or extinction of 
the mutant. 
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Let Fx denote the law of Q, as defined in the theorem, conditional on 
Supp(Co) = So = X. Fix i>0, mGN*, x £ X and a measurable subset F of 
X. Under P^, Ti and Sti are independent, Ti is an exponential random 
variable with parameter P{x), and Sti has law k{x,-). Therefore, for any 
n > 1, applying the strong Markov property to the process S at time Ti in 
the third line, 

Px{Tn < t < Tn+i,3z eT:Ct = mS,) 

= E,(l|5^er}l{T„<t<T„+i}IP(e(5t) = m)) 

(64) ^ 

= / p{x)e-f^^^> f Px+h{Tn-i < t - s < r„, 3z G F : Ct-s = mS,) 
Jo JR'' 

X k{x, dh) ds. 

Moreover, 

(65) P,(0 < t < Ti, 3z e F : G = m5,) = l{,gr|e"^("')*F(e(x) = m). 

These two relations characterize the one-dimensional laws of the process 
C,. The idea of our proof is to show that the same relations hold when we 
replace T„ by Tn and the support of C,t by the support of f^^^ (when it is a 
singleton) in the limit 7^0. 

More precisely, let us define for any uq£ M and n € N, 

pl{t,T,m,vo) ■=Wl^(^pn ^ ^ < T„+i,3z gF : u^j^ = m5^. 

We will prove the following lemma after the end of this proof. 

Lemma 6.5. For any x £ X , m,k>l, n > 0, i > and any measurable 
subset T of X , pn{t,T,m,x) ■.= lim^^Qp'^{t,T,m,kSx) exists, is independent 
of k and satisfies 

(66) po{t, F, m, x) = l|,er}e-^^"^*F(e(2:) = m) 
and 

Vn>l pn{t,T,m,x)= f /3(x)e-^('^)^ / p„_i(t - s, F, m, x + /i) 

(67) ^° 

X ^(x, d/i) ds. 



Comparing (64) and (65) with (66) and (67), this lemma implies that 
Pnit,T,m,x) = PxiTn <t< Tn+i,3z £T:Ct = mSz). 
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Recall that i'q = Nq6x with sup^g^Q E((A''q)p) < oo for some p > 1. By 
Proposition 2.3, sup^g(o,i) supt>oIE((f7, 1)^) < +oo and 



\Fl,{3z e r : = m5,) - P,(3z e F : Ct = m5,)\ 



M 



k=l 



^Pniti r, m, kSa:) - Pn{t, T, Ul, x)) 

n=0 



Because of Lemma 6.2 (57), the quantity inside the absolute value in the 
r.h.s. of this equation vanishes as 7 — > 0. Thus, 

(68) 1™ e r : z.J^ = m6,) = P,(3z G T : ^ = m6,). 

Taking T = X and summing this relation over m G N*, Fatou's lemma yields 

(69) lirn (Supp(f^'^y^) is a singleton) = 1. 

Now, consider a bounded measurable / : — > M such that /(u) = if {u, 1) 7^ 
m G N* and define the function / : A" ^ M by f{x) = f{m6x)- Then, it follows 
from (68) and (69) that 

limE\(/(i/7, )) 

" ^ifo^^^o '^•^'^^^PP(^i/7))! Supp(i/7/^) is a singleton and (f//^, 1) = m) 

= Exif{St);Nt = m)=EMm- 
This equality generalizes to any bounded measurable f -.M using once 
again that sup^g(o,i) ^^((^i/-),) 1)^) < +00. This completes the proof of Theo- 
rem 3.1 for one-dimensional distributions. 

The extension to finite dimensional marginals can be proved exactly in 
the same fashion. □ 

Proof of Lemma 6.5. Recah /3(x) = ^(x)E(^(x)6(x,^(x))). The result 
is trivial when the mutation rate //(x) is 0. Let us assume that ^{x) ^ 0. We 
will prove this lemma by induction over n > 0. 

Fix X £ X , m,k > 1 and t > 0. First, we have already proved in (59) that 

p'^{t,T,m,k6x) = l{^.gr}IPfe5,((i^7/7'l) ="^'7n >t) 

L{x7/^=m} exp (^--fKx) X]3{x, X]^)ds 



l{xGr}E 



where X'^ has been defined in the proof of Lemma 6.3. Using (61) and the 
ergodic theorem for positive-recurrent Markov chains, we get 

li™ r, m, k6x) = lsx(zr}F{^{x) = m) exp{-fi{x)E{^{x)b{x, C{x)))t), 
7— >o 
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which entails (66). 

Then, fix n > 1 and assume that lim^^op1^_^{t,r,m,k6x) = Pn{t,T,m,x) 
for any t > 0,T C X ,x X and m,k> 1. Applying the strong Markov prop- 
erty to the process v"' at time ti, and using the fact that the mutant trait 
at this time is x + U, where U has law M(x, dh) and is independent of i^ri-i 
we get 

(71) 

= / lE^5jl{7n<t}^'n-i(*-7n,r,m,(i/7 l)5^ + (5^.+h)]M(x,d/i). 

Now, we want to apply the strong Markov property to i'"' at time po to 
compute the quantity p'J^_i{s, T, m, I5x + 5y) appearing inside the expectation 
in the last formula. For K > 0, distinguishing between the cases where po > 
n, (fpo,l) > K,Vo = x and Vq = y yields 

pl_i{s,r,m,l6x + Sy) 

= ^ls,+Sy [l{po<ri,(z.?„,l><i^,Vb=x}Pn-l(s - IPO, r, m, (Z/;^ , 1)4)] 

+ ^75^+5, [l{po<n,W„,i><i^,Vb=j/}^'n-i(« - 7P0,r,m, {ul^,l)6y)] 

+ ^k+Syi{po > n} nE) + F75.+5,({po < ri} n {(z.^, i) > i^} n E), 

where 

-E' = {Pn-i < s/t < r„, 3z G r : ly^f-y = m6z}. 

The third term of the r.h.s. vanishes as 7 ^ because of Lemma 6.4(a) 
and the last term vanishes as X — > -|-oo uniformly for 7 € (0, 1) because of 
Lemma 6.4(b). 

As for the first two terms, assume that p'J^_^{t,T,m,k5x) converges to 
Pn-i{t,T,m,x) as in the statement of Lemma 6.5. As a consequence of 
Lemma 6.2 (56), for any t > 0, the function s ^ p^_i{s,T,m,k6x) is uni- 
formly continuous on [0,t], uniformly in 7. Combining this observation with 
Lemma 6.4(c), 

lini (s, r, m, I5x + 6y) 

(72) 

= ui^i{x,y)pn-i{s,r,m,y) + {1 - ui^i{x,y))pn-iis,T,m,x). 

This uniform continuity argument also applies to s 1— > p^_-^(s, L, m, /J^ + 
6y), so that the convergence in (72) is uniform in s G [0, t] and /€{1,...,L}, 
for fixed L > 1. Therefore, distinguishing between {^1^^-, 1) < L and (z^^^-, 1) > 
L, we can combine Lemma 6.3(a) and (b) to get 

li"^,^fc5jl{7ri<t}^'n-i(* - 7n,r,m, (i/7^„, l)6x + dy)] 
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= t ds I3{x)e-f^^''^' 
Jo 

^^y^ /fe(x,OP(e(x) = ^) 

E(e(x)6(x,^(x))) 

X [ui,i{x, y)Pn-i{t -s,r,m,y) 

+ (1 - ui^i{x,y))pn-i{t - s,T,m,x)]. 

Finally, using Lebesgue's theorem, this limit applies inside the integral in (71), 
which gives exactly (67) and ends the proof of Lemma 6.5. □ 

Proof of Theorem 3.2. Since the hmiting law of the process (5*7; t > 
0) is characterized by its finite-dimensional distributions, obtained in The- 
orem 3.1, we only have to show the tightness of their laws. Fix T > 0. By 
Ascoli's theorem for cdlg functions (see, e.g., [2]), we have to show that, for 
any e,7] > 0, there is 5 > such that 

(73) limsupP(a;'(5^, 6) > r]) < e, 

where the modulus of continuity to' is defined as 

uj'{f,6) = inil max w(/, [U, U+i)) \, 

where the infimum is taken over all finite partitions Q = tQ <ti < ■ ■ ■ Kt^. = T 
of [0, T] such that tj+i — ti> 6 for any < i < r — 1, and where to is the usual 
modulus of continuity 

a;(/,I)=sup \\f{t)-f{s)\\. 
s,tei 

Now, fix e > and, by Lemma 6.2 (57), choose N such that P'^(7r7v < T") < 
e/2 for any 7 < 1. For any n< N, 

r'{pn+i -pn< Vt) < ^Hpn " r„ > 5/j) + P^(t„+i - r„ < 25/7)- 

By Lemma 6.2 (56) and Lemma 6.3(b), one can choose 6 such that the 
second term is bounded by e/2N uniformly in 7. Then, by Lemma 6.4(a) 
and Lemma 6.3(b), the first term goes to when 7^0. Therefore, for any 
e > 0, there exists 6 > such that 

limsupP^(3n > : pn+i - Pn < and pn+i < r/7) < e, 
which implies (73). □ 
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6.3. Proof of Theorem 4.1. Since Vn,m = on ili U ^l2, we will always 
assume n,m>l. Recall the definition (10) of the transition probabilities 
7rjj(x, y) G N^) of the embedded Markov chain 1^; n > 0) associated 
to the (x, y)-type GL-population {Xt, Yt;t>0) without mutation. Recall also 
the notation 7rii,...,i^ (x, y) for the product vrj^jj {x, y)7rj2i3 (x, y) ■ ■ ■ 'ni^_^i^ (x, y) 
and 5(„ „j)^r the set of paths linking {n,m) to a subset T of without 
hitting Qi U before F, that is, the set of all /c-tuples {11,12, ■ ■ ■ ,ik) for all 
k>l such that ii = (n, m), 12, - ■ ■ , ik-i G \ (^^i U ^2) and ik € F. 

Now, 

Un,m{x,y)= T^h,-,iki^^y)^ 
fc>2,(ji,...,jfc)g5(„,„)_ni 

so if we prove that 

Rn,m{x,y) ■■= 5Z 

is finite, we get the differentiability of Un,m{x, y) and the inequality \dun,m{x, y) / 
dy\ < Rn,m{x,y). Observe that 

fc-i 

Rn,m{x,y)<Cx 

fc>2,(ii,...,ife)e5(„,m)^nj^ 1=1 

where C\ is defined in assumption (11) and TTi^i{x,y) = 1 by convention. 
Next, with || • || denoting the L^-norm in Z^, 

Rn,ni{x,y) <CiY Y '^h,...,ii{x,y) 

l>l (n',m')e{N*)2 (n,...,ii)6S(„_^)_(„,,,„,) 

\\e\\=l fe'>0,(ji,...,jj^,)e5(„, 

with the convention that k' = if (n' ,m') + e G f^i, so that, if Tr denotes 
the first hitting of T C by {X, Y), 

Rn,m{x,y) <CiY Y Y '^h,...,ii{x,y) 

l>l (n',m')G(N*)2 (n ,...A)e5(„^„)^(„,_„,) 

n',m')+e 

<4Ci^P„,^(f>0 

Z>1 

= 4CiE„,„(f -1). 



5w 
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The proof of (12) is completed thanks to Proposition 6.1(a). 

(b) Following exactly the same method as above, we obtain from (54) that 



E 

(il,...,ife)G5{„^m)^nj^ 



<4CfE E E ^n,...,Hi^,y) 

l>l (n',m')e(N-)2 (ii,...A)eS(„_„)_(„,,„,) 
+ 4C2E„,^(f-l) 

<16C2C^ J2 E vr,,,...,^,(x,y)(n' + m') 

/>1 (n',m')6(N-)2 (ii,...A)65(„_,„)_(„,_,„,) 

+ 4C2C(n + m) 

< l6C^Cj2{n + m + l)Fn,m{f > I) + AC2C{n + m) 

i>i 

< l6CfCEn,m{{f - l)(n + m + f/2)) + 4C2C(n + m), 
and the result follows again from Proposition 6.1(a). 

6.4. Proof of Theorem 4.2. We will use the classical method of tightness 
and martingale problem formulation to prove this theorem (e.g., [18]). We 
divide the proof into three steps: 

Step 1. Uniqueness of the limit process. Strong existence and uniqueness 
for the SDE (15) follow standardly from the Lipschitz-continuity of its co- 
efficients. 

Step 2. Tightness of the family of laws of Z^. For any e > 0, let N^(dh, du, dt) 
be a Poisson point process on M'"' x [0, 1] x with intensity measure qe{dh, du, 
dt) = M{h) dhPxdudt/e'^ , where (3 and x are constants bounding the func- 
tions P and X from above, respectively, and M has been defined as the 
integrable function bounding the density ?n(x, •) of M{x, ■) for any x € M'^. 
Then it is straightforward to check that is the infinitesimal generator of 
the Markov process Z'': 
t 

Jo 



Zt-Z'o + e 1^ 1^ /^^,^l{«<{/3(Z|_)/^)(x{Z|.,Z|_+eh)/x)(m(Z|_,h)/M(h))} 

X N^{dh, du, ds). 



Since /? and x bounded, a process generated by A^^ is unique in law 
(e.g., [10]), and this construction characterizes the law of the process Z"^ 
appearing in the statement of Theorem 4.2. Let us denote this law by P^. 
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Observe that, if we denote by the compensated Poisson measure — 
Qe, Zf can be decomposed as Zq + Z| + Z|, where 

" i) ^■^{^<WZl-)/^)ixiZl-,Zl_+eh)/x){m{ZI_^)/M{h))}^^^^ 

and 

Zt = - f I hl3{Zl_)x{Zl_,Zl_ + eh)M{Zl_,dh) ds 

= - f I h(3{Zl_)[x{ZI_,Zl_ + eh) - x{Zl_,Zl_)]M{ZI_,dh) ds, 
e JO JR'' 

where the last equahty fohows from the fact that the mutation step law 
M(x, ■) has expectation. 

We will use Aldous' criterion [1] to prove the tightness of the family 
of probability measures (Pe)e>o on D(M+,M''). Fix 6,e> and let r and 
t' be two stopping times such that t < t' < t + 6. Since \xix,x + eh) — 
x{x,x)\ < eK\\h\\ for some constant K, \\Z^, — Z^\\ < 5(3KM2, where M2 = 
sup^,/ ||/i|pM(x, d/i), which is finite by assumption. By standard results on 
stochastic integrals with respect to Poisson point measures, 



EJ\\ZL-Z'J^) 



:EJ / / e'Whin 



g jj^, {n<{l3{ZI_)/^){x{ZI_,ZI_+eh)/xKni(ZI_,h)/M{h))} 

X qe{dh, du, ds) 

< SPxM2. 
Therefore, for any t] > 0, 

P,(||Z^, - Z^ll > r?) < P, _ Z^ll > 1^ + -Zr\\>l 

which converges to as 5 ^ 0, uniformly w.r.t. the choice of r and t'. This 
is the first part of Aldous' criterion. For the second part, we have to prove 
the tightness of (Z^ )e>o for any t>0. Similar computations as above prove 
easily that (Z^ )e>o and (Z|)e>o are tight, and the tightness of {Zq)^^q follows 
from the assumption that it is bounded in L^. 

Step 3. Martingale problem. Let Pq be an accumulation point of (Pe)(;>o 
as e — > on B(]R+,R'^), endowed with the canonical filtration !Ff Since the 
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martingale problem for (15) is well posed, it suffices to show that, for any 
if G C^(A'), under Pq, the process 

Mf{w) = ip{wt) - (p{wo) - [ Aoip{ws) ds 



is a local ^t-martingale. We already know that, under P^, 



on 



Mp'-^{w) = (p{wt) - (p{wo) - / A^(f{ws) ds 

Jo 

is a local ^^-martingale. Since /? and x bounded, this is a square- 
integrable martingale as soon as (/? G . 

Fix If £ C^, s > and t > s, and consider p real numbers < ti < • ■ • < 
tp<s for some p>l, and a continuous bounded function q : {M.^y —)■ M. We 
can write 

rt 



Eos qiwt^,...,Wtp) 



(p{wt) - (p{ws) - / Ao(p{wu) du 



< 



+ 



+ 



-l{wt^,...,wtj,) 



(p{wt) - fiWs 



A^ip{wu) du 



'EAq{wti,...,wtp) / {A^(p{wu) - Ao(p{wu)) du 



Bo< q{wt^,...,wtp) 



AQ(p{wu)du 



eJ q{wtj_, 



ip{wt) - f{ws) - / Aoip{wu) du 



The first term of the r.h.s. is since M^''^ is a P^-martingale. Because of 
the uniform convergence of generators (14), the second term converges to 
as e — 0. The third term also goes to as e — because P^ converges to 
Pq. Finally, since the l.h.s. does not depend on e, it is 0. 

A classical use of the monotone class theorem allows to extend this equal- 
ity to all ^s-measurable bounded functions q, so is a Pg-martingale. 
This result can easily be extended to any function by a standard trun- 
cation technique, which completes the proof of Theorem 4.2. 
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